A Simple MLOps Pipeline on Your Local Machine

A Simple MLOps Pipeline on Your Local Machine

In this tutorial, i wil show you how to create A Simple MLOps Pipeline on Your Local Machine. Docker Desktop, Kubernetes and Other Open Source Tooling to Demonstrate Machine Learning Process on your Laptop

It can be difficult to get any kind of ops experience outside of enterprise without turning to the cloud. The simple reason is that there’s little benefit in not turning to the cloud. In order to provide a zero-cost entry point into MLOps for those new to the space, I wanted to see if I could set up a simple MLOps pipeline in a reasonable amount of time on my personal laptop.

This is a “tip of the iceberg” tutorial for MLOps. Much of it will be modeled loosely after the famous Continuous Delivery for Machine Learning paper (Sato et al, 2019) — but with much less depth considering I’m just one dude putting in a few hours here and there. Instead of a real “pipeline”…think of it more like Michael Scott’s Tube City.

Some of technologies used will be:

  • Python
  • Docker/Kubernetes
  • Mlflow
  • Minio
  • Seldon Core
  • Github
  • Jenkins
  • ArgoCD

None of this is fit for production as outlined, but many of the principles and technologies are widely applicable. You’ll really only need Docker Desktop to follow along. This will enable you to run Kubernetes. However, you should also clone this repo, as it has all of the additional scripts we’ll need.

docker

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Docker Explained: Docker Architecture | Docker Registries

Following the second video about Docker basics, in this video, I explain Docker architecture and explain the different building blocks of the docker engine; docker client, API, Docker Daemon. I also explain what a docker registry is and I finish the video with a demo explaining and illustrating how to use Docker hub.

Docker Architecture Overview & Docker Components [For Beginners]

Docker Architecture Overview & Docker Components. This ultimate guide revolves around the underlying technologies used by Docker Containers to provide effective containerisation services to its users. It explains the entire Docker architecture and its components using intuitive diagrams.

Docker Tutorial for Beginners 8 - Build and Run C++ Applications in a Docker Container

Welcome to this on Docker Tutorial for Beginners. In this video provides an Introduction on C++ development with Docker containers. So we will see How to ship C++ Programs in Docker.

Docker: Installing Docker and Understanding basic docker commands

“Docker: Understanding Docker Architecture and Components”, The First thing we are going to do is to run the “docker run hello-world” command. This command tries to find the “hello-world” image locally and if not found, it then downloads an image from the docker hub and runs the container out of this image.

WordPress in Docker. Part 1: Dockerization

This entry-level guide will tell you why and how to Dockerize your WordPress projects.