How a Maintenance Routine ruined my Machine Learning model!

 How a Maintenance Routine ruined my Machine Learning model!

How a Maintenance Routine ruined my Machine Learning model! Based on an actual use-case, discover why you should take care of maintenance activities in your industrial modelization.

Based on a real use-case, discover why you should always take care of maintenance activities when modeling an industrial process… and what to do in case you did not!

Image for post

The Machine Learning Challenges:

Many Data Scientists do agree on the importance of data preparation before actually using machine learning algorithms. This challenge is usually depicted as the iceberg displayed on the left below.

The second challenge is probably to transfer a Proof of Concept (P.O.C.) to the real environment where data is collected live and predictions integrated into the existing digital infrastructure.

Image for post

But, in my opinion, the greatest challenge of all is to create a solution that will last over time:

Image for post

What is pleasant with industrial processes is that they usually do not change their behavior overnight as human consumers would do! (And if you need an example of strange behavior switch, just remember how irrational toilet paper shortages were when the first COVID lockdowns started and how hard it was for A.I. systems to cope with it!)

But even industrial machine learning models can drift apart as their robustness also relies on the 3 axioms of Data Science:

Image for post

From Good… to Great… to Worse!

As for every modeling project, it took me a few weeks from the moment one operational team came to me with a use case to solve and the time when the quality predictions were displayed live on a dashboard within the control room with a pretty good level of accuracy.

However, after a few weeks, a sudden drift in the accuracy of the predictions made me question the robustness of the whole model and, by extension, the stability of the industrial process!

Image for post

Predictions’ accuracy (MAE) over the last month

We see that the predictions of the last four days are beyond the robustness threshold we have defined with the team (2,2) and significantly above the Mean Absolute Error (M.A.E.) at 0,9.

machine-learning lessons-learned data-science maintenance towards-data-science deep learning

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Most popular Data Science and Machine Learning courses — July 2020

Most popular Data Science and Machine Learning courses — August 2020. This list was last updated in August 2020 — and will be updated regularly so as to keep it relevant

Difference between Machine Learning, Data Science, AI, Deep Learning, and Statistics

In this article, I clarify the various roles of the data scientist, and how data science compares and overlaps with related fields such as machine learning, deep learning, AI, statistics, IoT, operations research, and applied mathematics.

15 Machine Learning and Data Science Project Ideas with Datasets

Learning is a new fun in the field of Machine Learning and Data Science. In this article, we’ll be discussing 15 machine learning and data science projects.

PyTorch for Deep Learning | Data Science | Machine Learning | Python

PyTorch for Deep Learning | Data Science | Machine Learning | Python. PyTorch is a library in Python which provides tools to build deep learning models. What python does for programming PyTorch does for deep learning. Python is a very flexible language for programming and just like python, the PyTorch library provides flexible tools for deep learning.

Data Augmentation in Deep Learning | Data Science | Machine Learning

Data Augmentation is a technique in Deep Learning which helps in adding value to our base dataset by adding the gathered information from various sources to improve the quality of data of an organisation.