Azure Streaming Analytics and Anomaly Detection

Azure Streaming Analytics and Anomaly Detection

Let’s talk about this feature of Azure called stream analytics and how to detect an anomaly before it becomes a failure.

Let’s talk about this feature of Azure called stream analytics and how to detect an anomaly before it becomes a failure.

Data stream is a set of data that is coming through and is very transient, it’s not sitting in a traditional SQL database. If we had so , we can just run a batch job and run SQL query over that data and extract whatever insights we want under that data.

But what if we have data that is just passing through an event hub ?

How do we run queries, get reports, raise alerts if something becomes unusual ?

So we have this feature called Stream Analytics.

Streaming Analytics is a querying, alerting and monitoring tool that monitors streams instead of stationary databases. Now the use case that Microsoft presents is Internet of Things solution. ​ Say, if I have a watch or other devices and got millions of these devices out in the world and they are feeding back into an IOT Hub or a regular event hub. We may want to monitor those millions of events per second and detect something that is outside of a normal range and then to raise an alert or take a particular action based on detecting an above average quantity of those data. ​ Another example , say there are logs as people are visiting my website and writing log with 200 status codes and what resource they are viewing . It’s just a continuous stream of data of status code and resource path. So what if I can monitor log like that and be able to say if more than 20 of these 404/500 events happened within the last five minutes, I want to raise an alert by sending SMS message. It is real time analytics of a stream.

anomaly-detection machine-learning streaming-analytics azure

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Azure Machine Learning Service

In a series of blog posts, I am planning to write down my experiences of training, deploying and managing models and running pipelines with Azure Machine Learning Service.

Hire Machine Learning Developers in India

We supply you with world class machine learning experts / ML Developers with years of domain experience who can add more value to your business.

Forensic Analytics: Application of Machine Learning to Anomaly Detection

Fraudulent behavior can be seen across many different fields such as e-commerce, healthcare, payment and banking systems. Financial fraud has important implications for…

Beginner’s guide to Azure Machine Learning Studio using custom dataset

In simple terms, Machine Learning uses some set of algorithms to learn different examples of similar data to perform a specific task for a particular domain.

What is Supervised Machine Learning

What is neuron analysis of a machine? Learn machine learning by designing Robotics algorithm. Click here for best machine learning course models with AI