CoderzColumn : Tutorials Home (Page: 7)

CoderzColumn Tutorials

Learning is a lifelong process. But you must know what, where, and how to learn? What skills to develop? What skills will help you boost your career? If not, you are at the right place! Our tutorial section at CoderzColumn is dedicated to providing you with all the practical lessons. It will give you the experience to learn Python for different purposes and code on your own. Our tutorials cover:

  • Python Programming - threading, multiprocessing, concurrent.futures, asyncio, queue, imaplib, smtplib, email, mimetypes, cprofile, profile, tracemalloc, logging, ipywidgets, beautifulsoup, filecmp, glob, shutil, tarfile, zipfile, argparse, datetime, traceback, abc, contextlib, warnings, dataclasses, re, difflib, textwrap, collections, heapq, bisect, weakref, configparser, signa, ipaddress, xarray, pandas, subprocess, sched, etc.
  • Artificial Intelligence - PyTorch, Keras, Tensorflow, JAX, MXNet, Torchvision, Torchtext, GluonCV, GluonNLP, etc
  • Machine Learning - Scikit-Learn, Statsmodels, XGBoost, CatBoost, LightGBM, optuna, scikit-optimize, hyperopt, bayes_opt, scikit-plot, lime, shap, eli5, etc.
  • Data Science - missingno, seaborn, pandas, sweetviz, numpy, networkx, xarray, awkward-array, etc.
  • Data Visualization - Matplotlib, Bokeh, Bqplot, Plotnine, Altair, Plotly, Cufflinks, Holoviews, dash, streamlit, panel, voila, bokeh, geopandas, geoviews, folium, ipyleaflet, geoplot, cartopy, etc.
  • Digital Marketing - SEO tactics, marketing strategies, Social Media marketing, and more.

For an in-depth understanding of the above concepts, check out the sections below.

Recent Tutorials

Tags profiling, cProfile, profile
How to Profile Python Code using cProfile & profile?
Python

How to Profile Python Code using cProfile & profile?

A simple guide to profile Python code using libraries cProfile and profile. Both are available through standard python installation. They let us measure execution time of function calls made. Tutorial explains how to use libraries to profile code in Python script/program, from command line/shell, and in Jupyter Notebook as well.

Sunny Solanki  Sunny Solanki
Aug 16, 2022 ~25 mins
Tags scoring_metrics, scikit-learn
Scikit-Learn - Model Evaluation & Scoring Metrics
Machine Learning

Scikit-Learn - Model Evaluation & Scoring Metrics

A brief guide on how to use various ML metrics/scoring functions available from "metrics" module of scikit-learn to evaluate model performance. It covers a guide on using metrics for different ML tasks like classification, regression, and clustering. It even explains how to create custom metrics and use them with scikit-learn API.

Sunny Solanki  Sunny Solanki
Aug 15, 2022 ~45 mins
Tags loggging, events
logging - An In-Depth Guide to Logging in Python with Simple Examples
Python

logging - An In-Depth Guide to Logging in Python with Simple Examples

A detailed guide on how to use logging module of Python to log events. Tutorial provides an explanation of how to log events of different types (warning, error, info, debug, etc), format error messages, log messages to files, filter log messages, etc. It is useful for basic logging as well as advanced logging for application with many sub-modules.

Sunny Solanki  Sunny Solanki
Aug 14, 2022 ~45 mins
Tags tracemalloc, memory-tracing
tracemalloc - How to Profile Memory Usage By Python Code
Python

tracemalloc - How to Profile Memory Usage By Python Code

A comprehensive guide on how to use Python module tracemalloc to profile memory usage by Python code/script/program. Introduced in v3.4, it is a memory profiler that comes with default Python installation. Tutorial explains whole API of tracemalloc with simple examples.

Sunny Solanki  Sunny Solanki
Aug 13, 2022 ~30 mins
Tags magic-commands, jupyter-notebook
Useful Magic Commands in Jupyter Notebook / Lab
Python

Useful Magic Commands in Jupyter Notebook / Lab

A brief guide to using magic commands available in Jupyter notebooks. Magic commands are special commands starting with a single or double percent sign (%) that let us perform tasks that otherwise need a shell or another tool. Both line magic commands (%) and cell magic commands (%%) are covered in tutorial.

Sunny Solanki  Sunny Solanki
Aug 12, 2022 ~20 mins
Tags jupyter-notebook, content-display
How to Display Rich Outputs (image, sound, video, etc) in Jupyter Notebooks?
Python

How to Display Rich Outputs (image, sound, video, etc) in Jupyter Notebooks?

A simple guide on how to display rich media contents (rich outputs) like audio, video, image, animation, JSON, Latex, File links, Code, HTML, etc in the Jupyter notebooks. Python module IPython provides a list of methods (starting with "display_*()") that let us display contents of these types in Notebooks.

Sunny Solanki  Sunny Solanki
Aug 11, 2022 ~20 mins
Tags profiling, line_profiler
line_profiler: Line by Line Profiling of Python Code
Python

line_profiler: Line by Line Profiling of Python Code

A simple guide on how to profile your python code/script/program using line_profiler library that provides run time of code line by line. It explains how to profile whole script from command line ("kernprof") and individual parts of code ("LineProfiler") as well. The library also provides magic command (""%lprun") for usage in Jupyter notebooks.

Sunny Solanki  Sunny Solanki
Aug 10, 2022 ~20 mins
Tags eli5, interpret-ml-models
How to Use eli5 to Interpret ML Models and their Predictions [Python]?
Machine Learning

How to Use eli5 to Interpret ML Models and their Predictions [Python]?

A detailed guide on how to use Python library "eli5" to interpret/explain ML Models and their predictions. Tutorial explains simple sklearn ML Models trained on toy datasets to solve regression and classification tasks. It explains how to interpret predictions made by ML models on individual data examples. The usage of library is explained with structured data (tabular) as well as unstructured data (text).

Sunny Solanki  Sunny Solanki
Aug 09, 2022 ~60 mins
Tags imap, read-mails, manage-mailbox
imaplib - Simple Guide to Manage Mailboxes (Gmail, Yahoo, etc) using Python
Python

imaplib - Simple Guide to Manage Mailboxes (Gmail, Yahoo, etc) using Python

A comprehensive guide on how to use Python library "imaplib" to manage mailboxes (Gmail, Yahoo, etc). Tutorial covers various operations with mailbox like login/logout, list/create/rename/delete directories, search emails, read emails, copy emails, delete emails, mark emails as read/unread, flag emails as important, etc. It uses IMAP4 protocol behind the scene to communicate with the mailbox server.

Sunny Solanki  Sunny Solanki
Aug 07, 2022 ~30 mins
Tags lime, interpret-ml-models
How to Use LIME to Interpret Predictions of ML Models [Python]?
Machine Learning

How to Use LIME to Interpret Predictions of ML Models [Python]?

A detailed guide on how to use Python library lime (implements LIME algorithm) to interpret predictions made by Machine Learning (scikit-learn) models. LIME is commonly used to explain black-box as well as white-box ML models. We have explained usage for structured (tabular) as well as unstructured (image & text) data and classification as well as regression problems.

Sunny Solanki  Sunny Solanki
Aug 06, 2022 ~45 mins

Subscribe to Our YouTube Channel

YouTube SubScribe

Most Popular Tutorials

1. Candlestick Chart in Python (mplfinance, plotly, bokeh, bqplot & cufflinks)
2. ipywidgets - An In-depth Guide to Interactive Widgets in Jupyter Notebook
3. Simple Guide to Style Display of Pandas DataFrames
4. How to Use LIME to Understand sklearn Models Predictions [Python]?
5. imaplib - Simple Guide to Manage Mailboxes using Python

Tutorial Categories

Artificial Intelligence (83)
Data Science (84)
Digital Marketing (8)
Machine Learning (38)
Python (130)

Newsletter Subscription

Parallel Computing using Python

Parallel Computing using Python

Parallel Computing is a type of computation where tasks are assigned to individual processes for completion. These processes can be running on a single computer or cluster of computers. Parallel Computing makes multi-tasking super fast.

Python provides different libraries (joblib, dask, ipyparallel, etc) for performing parallel computing.

joblib

joblib
ipyparallel

ipyparallel
dask.distributed

dask.distributed
dask.delayed

dask.delayed
dask.bag

dask.bag
Concurrent Programming in Python

Concurrent Programming in Python

Concurrent computing is a type of computing where multiple tasks are executed concurrently. Concurrent programming is a type of programming where we divide a big task into small tasks and execute these tasks in parallel. These tasks can be executed in parallel using threads or processes.

Python provides various libraries (threading, multiprocessing, concurrent.futures, asyncio, etc) to create concurrent code.

threading

threading
multiprocessing

multiprocessing
concurrent.futures

concurrent.futures
asyncio

asyncio
asyncio - Synchronization Primitives

asyncio - Synchronization Primitives
queue

queue
Visualize Machine Learning Metrics

Visualize Machine Learning Metrics

Once our Machine Learning model is trained, we need some way to evaluate its performance. We need to know whether our model has generalized or not.

For this, various metrics (confusion matrix, ROC AUC curve, precision-recall curve, silhouette Analysis, elbow method, etc) are designed over time. These metrics help us understand the performance of our models trained on various tasks like classification, regression, clustering, etc.

Python has various libraries (scikit-learn, scikit-plot, yellowbrick, interpret-ml, interpret-text, etc) to calculate and visualize these metrics.

Scikit-Learn: ML Model Evaluation Metrics

Scikit-Learn: ML Model Evaluation Metrics
scikit-plot

scikit-plot
yellowbrick

yellowbrick
interpret-ml

interpret-ml
interpret-text

interpret-text
Interpret Predictions Of ML Models

Interpret Predictions Of ML Models

After training ML Model, we generally evaluate the performance of model by calculating and visualizing various ML Metrics (confusion matrix, ROC AUC curve, precision-recall curve, silhouette Analysis, elbow method, etc).

These metrics are normally a good starting point. But in many situations, they don’t give a 100% picture of model performance. E.g., A simple cat vs dog image classifier can be using background pixels to classify images instead of actual object (cat or dog) pixels.

In these situations, our ML metrics will give good results. But we should always be a little skeptical of model performance.

We can dive further deep and try to understand how our model is performing on an individual example by interpreting results. Various algorithms have been developed over time to interpret predictions of ML models and many Python libraries (lime, eli5, treeinterpreter, shap, etc) provide their implementation.

LIME

LIME
Shap Values

Shap Values
eli5

eli5
treeinterpreter

treeinterpreter
dice-ml

dice-ml
Python Data Visualization Libraries

Python Data Visualization Libraries

Data Visualization is a field of graphical representation of information / data. It is one of the most efficient ways of communicating information with users as humans are quite good at capturing patterns in data.

Python has a bunch of libraries that can help us create data visualizations. Some of these libraries (matplotlib, seaborn, plotnine, etc) generate static charts whereas others (bokeh, plotly, bqplot, altair, holoviews, cufflinks, hvplot, etc) generate interactive charts. Majority of basic visualizations like bar charts, line charts, scatter plots, histograms, box plots, pie charts, etc are supported by all libraries. Many libraries also support advanced visualization, widgets, and dashboards.

matplotlib (Static Charts)

matplotlib (Static Charts)
bokeh (Interactive Charts)

bokeh (Interactive Charts)
bqplot (Interactive Charts)

bqplot (Interactive Charts)
plotnine (Static Charts)

plotnine (Static Charts)
altair (Interactive Charts)

altair (Interactive Charts)
seaborn (Static Charts)

seaborn (Static Charts)
holoviews (Static & Interactive Charts)

holoviews (Static & Interactive Charts)
cufflinks (Interactive Charts)

cufflinks (Interactive Charts)
hvplot (Interactive Charts)

hvplot (Interactive Charts)
Pandas-Bokeh (Interactive Charts)

Pandas-Bokeh (Interactive Charts)
Advanced Data Visualizations using Python

Advanced Data Visualizations using Python

Basic Data Visualizations like bar charts, line charts, scatter plots, histograms, box plots, pie charts, etc are quite good at representing information and exploring relationships between data variables.

But sometimes these visualizations are not enough and we need to analyze data from different perspectives. For this purpose, many advanced visualizations are developed over time like Sankey diagrams, candlestick charts, network charts, chord diagrams, sunburst charts, radar charts, parallel coordinates charts, etc. Python has many data visualization libraries that let us create such advanced data visualizations.

Candlestick Charts

Candlestick Charts
Sankey Diagrams

Sankey Diagrams
Sunburst Charts

Sunburst Charts
Chord Diagrams

Chord Diagrams
Network Charts

Network Charts
Parallel Coordinates Charts

Parallel Coordinates Charts
Radar Charts

Radar Charts
Treemap Charts

Treemap Charts
Connection Maps

Connection Maps
Choropleth Maps

Choropleth Maps
Scatter & Bubble Maps

Scatter & Bubble Maps
Python Deep Learning Libraries

Python Deep Learning Libraries

Deep learning is a field in Machine Learning that uses deep neural networks to solve tasks. The neural networks with generally more than one hidden layer are referred to as deep neural networks.

Many real-world tasks like object detection, image classification, image segmentation, etc can not be solved with simple machine learning models (decision trees, random forest, logistic regression, etc). Research has shown that neural networks with many layers are quite good at solving these kinds of tasks involving unstructured data (Image, text, audio, video, etc). Deep neural networks nowadays can have different kinds of layers like convolution, recurrent, etc apart from dense layers.

Python has many famous deep learning libraries (PyTorch, Keras, JAX, Flax, MXNet, Tensorflow, Sonnet, Haiku, PyTorch Lightning, Scikeras, Skorch, etc) that let us create deep neural networks to solve complicated tasks.

PyTorch

PyTorch
Keras

Keras
JAX

JAX
Flax

Flax
MXNet

MXNet
PyTorch Lightning

PyTorch Lightning
Haiku

Haiku
Sonnet

Sonnet
Scikeras

Scikeras
Skorch

Skorch
Image Classification

Image Classification

Image classification is a sub-field under computer vision and image processing that identifies an object present in an image and assigns a label to an image based on it. Image classification generally works on an image with a single object present in it.

Over the years, many deep neural networks (VGG, ResNet, AlexNet, MobileNet, etc) were developed that solved image classification task with quite a high accuracy. Due to the high accuracy of these algorithms, many Python deep learning libraries started providing these neural networks. We can simply load these networks with weights and make predictions using them.

Python libraries PyTorch and MXNet have helper modules named 'torchvision' and 'gluoncv’ respectively that provide an implementation of image classification networks.

PyTorch (Torchvision): Image Classification using Pre-trained Networks

PyTorch (Torchvision): Image Classification using Pre-trained Networks
MXNet (GluonCV): Image Classification using Pre-trained Networks

MXNet (GluonCV): Image Classification using Pre-trained Networks
Image Classification using PyTorch CNNs

Image Classification using PyTorch CNNs
Image Classification using Flax (JAX) CNNs

Image Classification using Flax (JAX) CNNs
Image Classification using MXNet CNNs

Image Classification using MXNet CNNs