Why Data Science development is different from Software or Data/BI development

Why Data Science development is different from Software or Data/BI development

Why Data Science development is different from Software or Data/BI development

  • Bring production or actual data from various sources
  • Data engineer the data set for use case
  • Build a working data set for modelling
  • Run data set through various algorithms
  • Need large compute depending on use case
  • Compare the performance of model
  • Iterate through the process to find the best model outcomes
  • Once the algorithm is found, Create Training script
  • Create a model file
  • Validate the model with new data set to test the performance
  • if the performance is acceptable move forward, other wise go back to model development
  • Once acceptable performance is good create score script for realtime or batch inference
  • Create Evaluate or model compare script from previous run
  • Scoring script to check for model performance to trigger new model build
  • Save all the scripts in Github or some code repository
  • Create documentation on use case, model and it’s usage

QA and Production

  • Get the code from code repository
  • Create Azure DevOps or other pipeline tools to build the deployment process
  • Run the Training process with production data
  • Need large compute depending on use case
  • Run testing of the model
  • if the model performance is better than previous run then create Model brain file
  • Use the Score file to create REST Api
  • Create Docker container to run the Microservice
  • Create the container orchestration enginer (if new), other wise use existing
  • Deploy the new Rest API and decommission the old one (if exists)
  • When score model is used if performance degrade create a model train run and deployment

data-science machine-learning

What is Geek Coin

What is GeekCash, Geek Token

Best Visual Studio Code Themes of 2021

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

How To Build A Data Science Career In 2021

In Conversation With Dr Suman Sanyal, NIIT University,he shares his insights on how universities can contribute to this highly promising sector and what aspirants can do to build a successful data science career.

Hire Machine Learning Engineer | Offshore Machine Learning Experts

We are a Machine Learning Services provider offering custom AI solutions, Machine Learning as a service & deep learning solutions. Hire Machine Learning experts & build AI Chatbots, Neural networks, etc. 16+ yrs & 2500+ clients.

The Difference between Data Science, Machine Learning and Big Data!

Many professionals and 'Data' enthusiasts often ask, “What's the difference between Data Science, Machine Learning and Big Data?”. Let's clear the air. If you are still wondering about it then this article is for you.

5 stages of learning Data Science

5 stages of learning Data Science and how to ace each of them

Most popular Data Science and Machine Learning courses — July 2020

Most popular Data Science and Machine Learning courses — August 2020. This list was last updated in August 2020 — and will be updated regularly so as to keep it relevant