CoderzColumn : Python Tutorials (Page: 2)

Python Tutorials

Python is one of the most widely used programming languages today. This section is a large archive of tutorials, based on Python programming language. We cover the basic and advanced technical aspects through coding examples and snippets.

  • Parallel Computing
  • Concurrent Programming
  • Speed Up Python Code
  • Working with Emails
  • Profiling
  • Jupyter Notebook Helpers
  • Web Scraping
  • File & Directory Access
  • Work With Archives
  • Generic OS Services
  • Python Runtime Services
  • Text Processing Services
  • File Formats
  • Networking & Interprocess Communication
  • Image Processing

For an in-depth understanding of the above concepts, check out the sections below.

Recent Python Tutorials

Tags python, parallel-processing
joblib - Parallel Processing in Python
Python

joblib - Parallel Processing in Python

A detailed guide on how to use Python library joblib for parallel computing in Python. Tutorial explains how to submit tasks to joblib pool and then retrieve results. It even explains how to use various parallel computing backend like loky, threading, multiprocessing, dask, etc.

Sunny Solanki  Sunny Solanki
Aug 17, 2022 ~30 mins
Tags logging-configuration
logging.config - Simple Guide to Configure Loggers from Dictionary and Config Files in Python
Python

logging.config - Simple Guide to Configure Loggers from Dictionary and Config Files in Python

An in-depth guide to configure loggers from dictionary and config files. Python module "logging.config" provides us with various methods to create loggers from configuration details available through dictionary and config files. The tutorial explains methods (dictConfig() & fileConfig()) of module with simple examples.

Sunny Solanki  Sunny Solanki
Aug 16, 2022 ~30 mins
Tags profiling, cProfile, profile
How to Profile Python Code using cProfile & profile?
Python

How to Profile Python Code using cProfile & profile?

A simple guide to profile Python code using libraries cProfile and profile. Both are available through standard python installation. They let us measure execution time of function calls made. Tutorial explains how to use libraries to profile code in Python script/program, from command line/shell, and in Jupyter Notebook as well.

Sunny Solanki  Sunny Solanki
Aug 16, 2022 ~25 mins
Tags loggging, events
logging - An In-Depth Guide to Logging in Python with Simple Examples
Python

logging - An In-Depth Guide to Logging in Python with Simple Examples

A detailed guide on how to use logging module of Python to log events. Tutorial provides an explanation of how to log events of different types (warning, error, info, debug, etc), format error messages, log messages to files, filter log messages, etc. It is useful for basic logging as well as advanced logging for application with many sub-modules.

Sunny Solanki  Sunny Solanki
Aug 14, 2022 ~45 mins
Tags tracemalloc, memory-tracing
tracemalloc - How to Profile Memory Usage By Python Code
Python

tracemalloc - How to Profile Memory Usage By Python Code

A comprehensive guide on how to use Python module tracemalloc to profile memory usage by Python code/script/program. Introduced in v3.4, it is a memory profiler that comes with default Python installation. Tutorial explains whole API of tracemalloc with simple examples.

Sunny Solanki  Sunny Solanki
Aug 13, 2022 ~30 mins
Tags magic-commands, jupyter-notebook
Useful Magic Commands in Jupyter Notebook / Lab
Python

Useful Magic Commands in Jupyter Notebook / Lab

A brief guide to using magic commands available in Jupyter notebooks. Magic commands are special commands starting with a single or double percent sign (%) that let us perform tasks that otherwise need a shell or another tool. Both line magic commands (%) and cell magic commands (%%) are covered in tutorial.

Sunny Solanki  Sunny Solanki
Aug 12, 2022 ~20 mins
Tags jupyter-notebook, content-display
How to Display Rich Outputs (image, sound, video, etc) in Jupyter Notebooks?
Python

How to Display Rich Outputs (image, sound, video, etc) in Jupyter Notebooks?

A simple guide on how to display rich media contents (rich outputs) like audio, video, image, animation, JSON, Latex, File links, Code, HTML, etc in the Jupyter notebooks. Python module IPython provides a list of methods (starting with "display_*()") that let us display contents of these types in Notebooks.

Sunny Solanki  Sunny Solanki
Aug 11, 2022 ~20 mins
Tags profiling, line_profiler
line_profiler: Line by Line Profiling of Python Code
Python

line_profiler: Line by Line Profiling of Python Code

A simple guide on how to profile your python code/script/program using line_profiler library that provides run time of code line by line. It explains how to profile whole script from command line ("kernprof") and individual parts of code ("LineProfiler") as well. The library also provides magic command (""%lprun") for usage in Jupyter notebooks.

Sunny Solanki  Sunny Solanki
Aug 10, 2022 ~20 mins
Tags imap, read-mails, manage-mailbox
imaplib - Simple Guide to Manage Mailboxes (Gmail, Yahoo, etc) using Python
Python

imaplib - Simple Guide to Manage Mailboxes (Gmail, Yahoo, etc) using Python

A comprehensive guide on how to use Python library "imaplib" to manage mailboxes (Gmail, Yahoo, etc). Tutorial covers various operations with mailbox like login/logout, list/create/rename/delete directories, search emails, read emails, copy emails, delete emails, mark emails as read/unread, flag emails as important, etc. It uses IMAP4 protocol behind the scene to communicate with the mailbox server.

Sunny Solanki  Sunny Solanki
Aug 07, 2022 ~30 mins
Tags profiling, memory_profiler
memory_profiler: How to Profile Memory Usage in Python?
Python

memory_profiler: How to Profile Memory Usage in Python?

A detailed guide on how to use Python library "memory_profiler" to profile memory usage by Python code/script/program and processes. Tutorial covers various ways of profiling with "memory_profiler" like "@profile decorator", "mprof shell command", "memory_usage() function", etc. It even covers how to use "memory_profiler" in Jupyter notebook using "%mprun" and "%memit" magic commands.

Sunny Solanki  Sunny Solanki
Aug 05, 2022 ~20 mins

Subscribe to Our YouTube Channel

YouTube SubScribe

Most Popular Python Tutorials

1. ipywidgets - An In-depth Guide to Interactive Widgets in Jupyter Notebook
2. Simple Guide to Style Display of Pandas DataFrames
3. imaplib - Simple Guide to Manage Mailboxes using Python
4. logging.config - Simple Guide to Configure Loggers from Dictionary and Config Files
5. line_profiler: Line by Line Profiling of Python Code

Tutorial Categories

Artificial Intelligence (83)
Data Science (84)
Digital Marketing (8)
Machine Learning (38)
Python (130)

Newsletter Subscription

Parallel Computing using Python

Parallel Computing using Python

Parallel Computing is a type of computation where tasks are assigned to individual processes for completion. These processes can be running on a single computer or cluster of computers. Parallel Computing makes multi-tasking super fast.

Python provides different libraries (joblib, dask, ipyparallel, etc) for performing parallel computing.

joblib

joblib
ipyparallel

ipyparallel
dask.distributed

dask.distributed
dask.delayed

dask.delayed
dask.bag

dask.bag
Concurrent Programming in Python

Concurrent Programming in Python

Concurrent computing is a type of computing where multiple tasks are executed concurrently. Concurrent programming is a type of programming where we divide a big task into small tasks and execute these tasks in parallel. These tasks can be executed in parallel using threads or processes.

Python provides various libraries (threading, multiprocessing, concurrent.futures, asyncio, etc) to create concurrent code.

threading

threading
multiprocessing

multiprocessing
concurrent.futures

concurrent.futures
asyncio

asyncio
asyncio - Synchronization Primitives

asyncio - Synchronization Primitives
queue

queue
Speed Up Python Code

Speed Up Python Code

Python is an interpreter-based language and hence is slow compared to compiler-based languages (C / C++ / Java, etc). But we can make it super fast (Almost as fast as C++).

Python has a library named 'Numba' that can help us with it. Numba is a JIT Compiler (Just-In-Time) of Python. It converts Python code to faster machine-level code using 'LLVM' compiler.

To convert python code to low-level machine code, it provides us with various decorators (@jit, @njit, @vectorize, @guvectorize, @stencil, etc.). We can decorate our Python functions using these decorators to speed up our Python functions.

Numba even let us parallelize compiled code on multiple CPUs / GPUs for even faster completion.

Numba @jit Decorator

Numba @jit Decorator
Numba @vectorize Decorator

Numba @vectorize Decorator
Numba @stencil Decorator

Numba @stencil Decorator
Numba @guvectorize Decorator

Numba @guvectorize Decorator
Numba with Pandas

Numba with Pandas
Working with Emails in Python

Working with Emails in Python

Python provides various libraries to work with emails. Libraries to send emails, manage mailboxes and represent emails are different based on HTTP protocol.

To send emails, Python provides a library named 'smtplib' (based on SMTP protocol).

To manage mailboxes (read emails, flag emails, move emails, create folder / directory, delete email / directory, etc), Python offers a library named 'imaplib' (based on IMAP protocol).

To represent emails, Python has a library named 'email'. To determine MIME Type of attachment file, Python offers a library named 'mimetypes'.

imaplib

imaplib
smtplib

smtplib
email

email
mimetypes

mimetypes
Profile Python Code / Script / Program

Profile Python Code / Script / Program

Profiling is the process of recording time taken by Python program / code / script / process. It measures the time complexity of a program.

Apart from time, we can also record memory usage (space complexity) by our code / program. The process of recording memory usage is referred to as 'memory profiling'. Profiling can help us make better decisions regarding resource allocation as well it presents many opportunities to optimize existing code for maximum resource utilization.

Python has many libraries (cProfile, profile, line_profiler, memory_profiler, tracemalloc, pprofile, scalene, yappi, guppy, py-spy, pyinstrument, etc.) to profile time and memory usage by our Python code.

cProfile & profile

cProfile & profile
line_profiler

line_profiler
memory_profiler

memory_profiler
tracemalloc

tracemalloc
Snakeviz

Snakeviz