Category Archives: Uncategorized

Synthetic Regression Data Generation in Python

In one of my projects, I needed to to generate synthetic data for a regression model. After looking around I could not find anything satisfactory, including Scikit-Learn. I wanted to have more control over the data generation process. I decided … Continue reading

Posted in AI, Machine Learning, Python, Uncategorized | Tagged , | 3 Comments

Is Neural Network Better Off with Big Data

How does neural network or for that matter any machine learning model relates to Big Data. Do we get a better quality learning model with bigger data. That’s what we will explore in this post. We will explore sample complexity … Continue reading

Posted in Big Data, Data Science, Machine Learning, Optimization, Predictive Analytic, Uncategorized | Tagged , , , , , , , | 4 Comments

Detecting Incidents with Context from Log Data

Analyzing vast amount of machine generated unstructured or semi structured data is Hadoop’s forte. Many of us have gone through the exercise of searching log files, most likely with grep,  for some pattern and then looking at surrounding log lines … Continue reading

Posted in Big Data, Hadoop and Map Reduce, Log Analysis, Uncategorized, Web Analytic | Tagged , , , | Leave a comment

My blog 2013 review

The WordPress.com stats helper monkeys prepared a 2013 annual report for this blog. Here’s an excerpt: The concert hall at the Sydney Opera House holds 2,700 people. This blog was viewed about 57,000 times in 2013. If it were a … Continue reading

Posted in Uncategorized | Leave a comment

Stop the Customer Separation Pain with Bayesian Classifier

In my last post, we did some exploratory analytic for customer churn. We identified the parameters that have most influence on whether a customer account gets closed or not. We performed correlation analysis using Cramer index. In  this post, we will … Continue reading

Posted in Big Data, Data Mining, Data Science, Hadoop and Map Reduce, Predictive Analytic, Uncategorized | Tagged , | 9 Comments