CoderzColumn : Artificial Intelligence Tutorials (Page: 7)

Artificial Intelligence Tutorials

Artificial intelligence (AI) is the emulation of human intelligence in devices that have been designed to behave and think like humans. The phrase can also be used to refer to any computer that demonstrates characteristics of the human intellect, like learning and problem-solving. Through CoderzColumn Ai tutorials, you will learn to code for these concepts:

  • Python Deep Learning Libraries
  • Image Classification
  • Object Detection
  • Text Classification
  • Text Generation
  • Convolutional Neural Networks (CNNs)
  • Recurrent Neural Networks (RNNs)
  • Interpret Predictions Of Deep Neural Network Models
  • Learning Rate Schedulers
  • Hyperparameters Tuning
  • Transfer Learning
  • Word Embeddings (GloVe Embeddings, FastText, etc)
  • RNNs (LSTMs) for Time Series
  • Text Classification using RNNs, LSTM & CNNs

For an in-depth understanding of the above concepts, check out the sections below.

Recent Artificial Intelligence Tutorials

Tags optax, learning-rate-schedules
Optax: Learning Rate Schedules for Flax (JAX) Networks
Artificial Intelligence

Optax: Learning Rate Schedules for Flax (JAX) Networks

The tutorial covers learning rate schedules available from Optax Python library which has an implementation of optimizers (SGD, Adam, etc.) used by Flax (JAX) networks. Learning rate schedules anneals learning rate over time during training using various formulas to improve network performance.

Sunny Solanki  Sunny Solanki
Feb 02, 2022 ~45 mins
Tags learning-rate-schedules, keras
Simple Guide to Learning Rate Schedules for Keras Networks
Artificial Intelligence

Simple Guide to Learning Rate Schedules for Keras Networks

Learning rate schedules anneals learning rate during training over time to improve the performance of networks. The tutorial covers the majority of learning rate schedules available in Python deep learning library keras as well as explains how to create your custom schedule to anneal learning rate.

Sunny Solanki  Sunny Solanki
Jan 30, 2022 ~30 mins
Tags keras, callbacks
Simple Guide To Keras Callbacks
Artificial Intelligence

Simple Guide To Keras Callbacks

Keras callbacks are Python functions that let us perform some functionalities at the start of training, end of the training, the start of a batch, the end of a batch, the start of epoch, and the end of an epoch. It let us change learning rate, stop training, save model/weights, log metrics, etc. The tutorial explains them with simple examples.

Sunny Solanki  Sunny Solanki
Jan 27, 2022 ~30 mins
Tags recommendation-systems, collaborative-filtering, …
Recommender Systems (Collaborative Filtering) using Flax (JAX)
Artificial Intelligence

Recommender Systems (Collaborative Filtering) using Flax (JAX)

The tutorial covers a simple guide to designing recommendation systems using a collaborative filtering approach and Flax (JAX) Python deep learning framework. It covers 4 different simple models to solve the recommendation task.

Sunny Solanki  Sunny Solanki
Jan 24, 2022 ~45 mins
Tags haiku, cnn, jax
Haiku: Convolutional Neural Networks (CNNs)
Artificial Intelligence

Haiku: Convolutional Neural Networks (CNNs)

The tutorial covers how we can create convolutional neural networks using Haiku. It explains the different ways of creating neural nets and trains them with SGD and Adam optimizers. It also covers how to handle channels first vs channels last data formats. We try to solves image classification task using CNNs.

Sunny Solanki  Sunny Solanki
Jan 19, 2022 ~45 mins
Tags sonnet, tensorflow, cnn
Sonnet: Convolutional Neural Networks (CNNs)
Artificial Intelligence

Sonnet: Convolutional Neural Networks (CNNs)

The tutorial covers how we can create convolution neural networks using Sonnet. It also explains how we can handle channels first vs channels last data format with images. We try to solves image classification task using CNNs.

Sunny Solanki  Sunny Solanki
Jan 17, 2022 ~45 mins
Tags pytorch-lightning, neural-networks
PyTorch Lightning: Simplify Model Training by Eliminating Loops
Artificial Intelligence

PyTorch Lightning: Simplify Model Training by Eliminating Loops

PyTorch Lightning is a framework designed on the top of PyTorch to simplify the training process performed through loops. The tutorial explains how we can avoid loops for training, validation, and prediction when working with PyTorch using PyTorch Lightning.

Sunny Solanki  Sunny Solanki
Jan 14, 2022 ~45 mins
Tags flax, cnn
Flax: Convolutional Neural Networks (CNN)
Artificial Intelligence

Flax: Convolutional Neural Networks (CNN)

The tutorial guides individuals to create Convolutional Neural Networks using the Flax framework. Flax is a high-level flexible framework designed on top of JAX to make the task of designing neural networks easier. We try to solves image classification task using CNNs.

Sunny Solanki  Sunny Solanki
Jan 12, 2022 ~30 mins
Tags mxnet, cnn
MXNet: Convolutional Neural Networks (CNN)
Artificial Intelligence

MXNet: Convolutional Neural Networks (CNN)

The tutorial explains with simple examples how to create Convolutional Neural Networks using the Gluon API of MXNet framework. It also explains how to handle Channels First vs Channels Last formats. We try to solves image classification task using CNNs.

Sunny Solanki  Sunny Solanki
Jan 11, 2022 ~30 mins
Tags pytorch, cnn
PyTorch - Convolutional Neural Networks
Artificial Intelligence

PyTorch - Convolutional Neural Networks

The tutorial covers a guide to creating a convolutional neural networks using PyTorch. It explains how to create CNNs using high-level PyTorch API available through ‘torch.nn’ Module. We try to solves image classification task using CNNs.

Sunny Solanki  Sunny Solanki
Jan 07, 2022 ~30 mins

Subscribe to Our YouTube Channel

YouTube SubScribe

Most Popular Artificial Intelligence Tutorials

1. PyTorch Lightning: Simplify Model Training by Eliminating Loops
2. Scikeras : Give Scikit-Learn like API to your Keras Neural Networks
3. How to Use GloVe Word Embeddings With PyTorch Networks?
4. PyTorch RNN For Text Classification Tasks
5. Simple Guide to Learning Rate Schedules for Keras Networks

Tutorial Categories

Artificial Intelligence (83)
Data Science (84)
Digital Marketing (8)
Machine Learning (38)
Python (130)

Newsletter Subscription

Python Deep Learning Libraries

Python Deep Learning Libraries

Deep learning is a field in Machine Learning that uses deep neural networks to solve tasks. The neural networks with generally more than one hidden layer are referred to as deep neural networks.

Many real-world tasks like object detection, image classification, image segmentation, etc can not be solved with simple machine learning models (decision trees, random forest, logistic regression, etc). Research has shown that neural networks with many layers are quite good at solving these kinds of tasks involving unstructured data (Image, text, audio, video, etc). Deep neural networks nowadays can have different kinds of layers like convolution, recurrent, etc apart from dense layers.

Python has many famous deep learning libraries (PyTorch, Keras, JAX, Flax, MXNet, Tensorflow, Sonnet, Haiku, PyTorch Lightning, Scikeras, Skorch, etc) that let us create deep neural networks to solve complicated tasks.

PyTorch

PyTorch
Keras

Keras
JAX

JAX
Flax

Flax
MXNet

MXNet
PyTorch Lightning

PyTorch Lightning
Haiku

Haiku
Sonnet

Sonnet
Scikeras

Scikeras
Skorch

Skorch
Image Classification

Image Classification

Image classification is a sub-field under computer vision and image processing that identifies an object present in an image and assigns a label to an image based on it. Image classification generally works on an image with a single object present in it.

Over the years, many deep neural networks (VGG, ResNet, AlexNet, MobileNet, etc) were developed that solved image classification task with quite a high accuracy. Due to the high accuracy of these algorithms, many Python deep learning libraries started providing these neural networks. We can simply load these networks with weights and make predictions using them.

Python libraries PyTorch and MXNet have helper modules named 'torchvision' and 'gluoncv’ respectively that provide an implementation of image classification networks.

PyTorch (Torchvision): Image Classification using Pre-trained Networks

PyTorch (Torchvision): Image Classification using Pre-trained Networks
MXNet (GluonCV): Image Classification using Pre-trained Networks

MXNet (GluonCV): Image Classification using Pre-trained Networks
Image Classification using PyTorch CNNs

Image Classification using PyTorch CNNs
Image Classification using Flax (JAX) CNNs

Image Classification using Flax (JAX) CNNs
Image Classification using MXNet CNNs

Image Classification using MXNet CNNs
Object Detection

Object Detection

Object detection is a sub-field of computer vision and image processing that detect presence of one or more objects in an image and draws a bounding box around them with labels above. It detects semantic objects present in an image.

Object detection has many applications like image captioning, image annotation, vehicle counting, activity recognition, face detection, etc.

Over the years, many deep neural networks (R-CNN, Faster R-CNN, SSD, Retina Net, YOLO, etc) have been developed to solve object detection tasks. They are quite good at the tasks.

Python deep learning libraries PyTorch and MXNet provide an implementation of these algorithms through helper modules 'torchvision’ and 'gluoncv’. We can simply load these neural networks with weights and make predictions by giving input images.

PyTorch (Torchvision): Object Detection using Pre-trained Networks

PyTorch (Torchvision): Object Detection using Pre-trained Networks
MXNet (GluonCV): Object Detection using Pre-trained Networks

MXNet (GluonCV): Object Detection using Pre-trained Networks
Image Segmentation

Image Segmentation

Image segmentation as the name suggests is the process of segmenting an image into sections where sections are generally objects like humans, animals, cars, traffic lights, etc. During segmentation process, we assign typically labels to each pixel such that all pixels of one object have same labels.

Image segmentation has various applications like face detection, video surveillance, medical imaging, pedestrian detection, detecting objects in satellite images, etc.

Image segmentation can be solved using various non-ML-based methods (thresholding-based methods, clustering based methods, histogram-based methods, etc) as well as ML algorithms (U-Net, Fast-FCN, Mask R-CNN, DeepLab, LRASPP, etc) developed over years.

Python library scikit-image provides an implementation of various non-ML methods of solving image segmentation. For ML-based implementation, Python deep learning libraries PyTorch and MXNet have helper modules named torchvision and gluoncv that provide pre-trained, deep learning models, for image segmentation.

PyTorch (Torchvision): Image Segmentation using Pre-trained Networks

PyTorch (Torchvision): Image Segmentation using Pre-trained Networks
MXNet (GluonCV): Image Segmentation using Pre-trained Networks

MXNet (GluonCV): Image Segmentation using Pre-trained Networks
Text Classification

Text Classification

Text classification also referred to as document classification is a problem in computer science where each text document is assigned a unique category or label based on its content.

In order to classify text documents using deep neural networks, the text content of documents needs to be converted to real values. There are many approaches to converting text data to real-valued data like bag of words (word frequency, one-hot encoding, etc), Tf-IDF, Word embeddings, character embeddings, etc.

Once data is converted to real-valued data, deep neural networks of different types (Multi-Layer Perceptron, CNN, LSTM, etc) can be used to classify text documents. Neural networks can be designed with any Python deep learning library. Many libraries provide helper functionalities to handle text data.

Text Classification using PyTorch

Text Classification using PyTorch
Text Classification using Keras

Text Classification using Keras
Text Classification using JAX

Text Classification using JAX
Text Classification using MXNet

Text Classification using MXNet
Text Classification using Haiku

Text Classification using Haiku
Text Generation

Text Generation

Text generation also referred to as natural language generation is a sub-field of natural language processing (NLP) involving generation of new text. Text generation has various applications like generating reports, image captions, chatbots, etc.

Deep neural networks especially Recurrent neural networks and their variants (LSTM, GRU, etc) are proven to give good results for text generation tasks due to their ability to remember sequences.

Python deep learning libraries PyTorch, keras, MXNet, Flax, etc can be used to design RNNs to solve text generation task.

Text Generation using PyTorch LSTM Networks

Text Generation using PyTorch LSTM Networks
Text Generation using Keras RNNs

Text Generation using Keras RNNs
Text Generation using MXNet LSTM Networks

Text Generation using MXNet LSTM Networks
Text Generation using Keras LSTM Networks

Text Generation using Keras LSTM Networks
Interpret Predictions Of Deep Neural Networks

Interpret Predictions Of Deep Neural Networks

After training deep neural networks, we generally evaluate the performance of model by calculating and visualizing various ML Metrics (confusion matrix, ROC AUC curve, precision-recall curve, silhouette Analysis, elbow method, etc).

These metrics are normally a good starting point. But in many situations, they don’t give a 100% picture of model performance. E.g., A simple cat vs dog image classifier can be using background pixels to classify images instead of actual object (cat or dog) pixels.

In these situations, our ML metrics will give good results. But we should always be a little skeptical of model performance.

We can dive further deep and try to understand how our model is performing on an individual example by interpreting results. Various algorithms have been developed over time to interpret predictions of deep neural networks and many Python libraries (lime, eli5, treeinterpreter, shap, captum, etc) provide their implementation.

Captum

Captum
LIME for Image Classification

LIME for Image Classification
LIME for Text Classification

LIME for Text Classification
SHAP Values for Image Classification

SHAP Values for Image Classification
SHAP Values for Text Classification

SHAP Values for Text Classification
Grad-CAM using PyTorch

Grad-CAM using PyTorch
Eli5 for Image Classification

Eli5 for Image Classification
Eli5 for Text Classification

Eli5 for Text Classification
Learning Rate Schedulers

Learning Rate Schedulers

Learning rate is one of the most important hyperparameters during training of deep neural networks. A good learning rate can help neural networks converge quite faster.

Various experiments have shown that varying learning rate during training gives quite better results compared to keeping it constant throughout training process. It is recommended to gradually reduce learning rate over time during training. The process of changing learning rate during training is referred to as learning rate scheduling or learning rate annealing. The learning rate can be changed after each epoch or each batch.

Python deep learning libraries provide various ways to perform learning rate scheduling. Some common LR scheduling techniques like step LR, exponential LR, lambda LR, cyclic LR, cosine LR, etc are available in majority of libraries.

PyTorch Learning Rate Schedulers

PyTorch Learning Rate Schedulers
Keras Learning Rate Schedulers

Keras Learning Rate Schedulers
MXNet Learning Rate Schedulers

MXNet Learning Rate Schedulers
Optax Learning Rate Schedulers

Optax Learning Rate Schedulers
JAX Learning Rate Schedulers

JAX Learning Rate Schedulers