Category Archives: Python

Route Planning with DynaQ Reinforcement Learning

Posted on April 23, 2024 by Pranab

The purpose of a simple route planning is to find the optimum route from one location to another that minimizes travel distance or time. Generally various heuristic optimization techniques are used to find optimum route. In this post we will … Continue reading →

Posted in AI, Machine Learning, Python, Reinforcement Learning | Tagged , , , , , , , | Leave a comment

Time Series Classification with Neural Network using Random Sub Sequence Statistics as Features

Posted on January 26, 2024 by Pranab

Deep Learning models generally extract features in the early layers of the network. It does away with the need for manual feature engineering making it attractive ML technique. However, this not always the case, time series clustering and classification being … Continue reading →

Posted in AI, Machine Learning, Python, PyTorch, Time Series Analytic | Tagged , , , , , | Leave a comment

Time Series Forecasting with Decomposition and Two Linear Networks

Posted on December 28, 2023 by Pranab

Many solutions for time series forecasting are available, starting from classic ARIMA to Deep Learning Transformer based. Results are varied. There doesn’t appear to be any consensus for the best performing forecasting model overall. In this post, we will go … Continue reading →

Posted in AI, Machine Learning, Python, PyTorch, Time Series Analytic, Time Series Forecasting | Tagged , , , | Leave a comment

Time Series Data Exploration with Wavelet Transform

Posted on September 29, 2023 by Pranab

Time series data provides time domain information and Fast Fourier Transform provides frequency domain information only. What if you wanted both, for example you may be interested in frequency domain information only within a specified time range. Wavelet transform provides … Continue reading →

Posted in Anomaly Detection, Data Science, Python, Time Series Analytic | Tagged | Leave a comment

Store Inventory Replenishment with Q Value Reinforcement Learning

Posted on August 25, 2023 by Pranab
Posted in AI, Machine Learning, Python, Reinforcement Learning | Tagged , , | Comments Off on Store Inventory Replenishment with Q Value Reinforcement Learning

Online Advertisement Placement with Contextual Bandit.

Posted on July 27, 2023 by Pranab

There is a class of algorithms called Multi Arm Bandit (MAB) applicable for Reinforcement Leaning problems without state. Sometimes there is side information available for each action. MAB algorithms that take this side information aka context into account are called … Continue reading →

Posted in AI, Data Science, Machine Learning, Python, Reinforcement Learning | Tagged , | Leave a comment

Time Series Sequence Anomaly Detection with Markov Chain

Posted on June 28, 2023 by Pranab

There are many algorithms for anomaly detection in time series including Deep Learning based solutions. The anomalies are of 2 types, point and sequence. Sequence anomaly detection is generally of more interest for time series data. In this post we … Continue reading →

Posted in Anomaly Detection, Data Science, Machine Learning, Python, Statistics, time series | Tagged , | Leave a comment

Realtime Concept Drift Detection for Machine Learning Classification Models

Posted on May 29, 2023 by Pranab

Concept drift can occur when the relationship between the input and output data changes i.e P(Y|X) changes while P(X) remains same. It happens when the behavior of the underlaying process has changed with respect to the model training time. This … Continue reading →

Posted in AI, Anomaly Detection, Machine Learning, mlops, Python | Tagged , , | Leave a comment

Delivery Vehicle Route Planning with Ant Colony Optimization

Posted on April 28, 2023 by Pranab

Many real world optimization problems are not simple and linear that’s amenable to neat closed form solution. For such problems there are various heuristic optimization techniques. These heuristics algorithms find good enough sub optimal solutions while limiting computing cost. Many … Continue reading →

Posted in Optimization, Python | Tagged , , | Leave a comment

Synthetic Time Series Data Generation

Posted on March 29, 2023 by Pranab

Recently I started working on a Python package which is everything time series, with specific focus on EDA, forecasting, classification and anomaly detection. It will leverage other Python libraries wherever appropriate. My first realization was that I need a Python … Continue reading →

Posted in Data Science, Python, time series | Tagged , | 3 Comments