Tag Archives: stream processing

Alarm Flooding Control with Event Clustering Using Spark Streaming

Posted on September 19, 2016 by Pranab

You show up at work in the morning and open your email to find 100 alarm emails in your inbox for the same error from an application running on some server within a short time window of 1 minute. You … Continue reading →

Posted in Anomaly Detection, Big Data, Real Time Processing, Spark, stream processing | Tagged , , , | 1 Comment

Big Data Caught in Storm

Posted on February 25, 2012 by Pranab

Hadoop is great for batch processing. However depending on the  incoming data throughput and the cluster characteristic, there is a minimum latency threshold for processing data. My blog post is based on a simple performance model for Hadoop that allows … Continue reading →

Posted in Big Data, Predictive Analytic, Real Time Processing | Tagged , | 12 Comments