Data science workflows on Kubernetes with Kubeflow pipelines: Part 2

Data science workflows on Kubernetes with Kubeflow pipelines: Part 2


This blog series is part of the joint collaboration between Canonical and Manceps. Visit our AI consulting and delivery services page to know more. Introduction Kubeflow Pipelines are a great way to build portable, scalable machine learning workflows. It is a part of the Kubeflow project that aims to reduce the complexity and time involved with training and deploying machine learning models at scale. For more on Kubeflow, read our Kubernetes for data science: meet Kubeflow post. In this blog series, we demystify Kubeflow pipelines and showcase this method to produce reusable and reproducible data science. 🚀 In Part 1, we covered WHY Kubeflow brings the right standardization to data science workflows. Now, let’s see HOW you can accomplish that with Kubeflow Pipelines. In Part 2 of this blog series, we’ll work on building your first Kubeflow Pipeline as you gain an understanding of how it’s used to deploy reusable and reproducible ML pipelines. 🚀 Now, it is time to get our hands dirty! 👨🏻‍🔬 Building your first Kubeflow pipeline In this experiment, we will make use of the fashion MNIST dataset and the Basic classification with Tensorflow example and turn it into a Kubeflow pipeline, so you can repeat the same process with any notebook or script you already have worked on. You can follow the process of migration into the pipeline on this Jupyter notebook. Ready? 🚀 Step 1: Deploy Kubeflow and access the dashboard If you haven’t had the opportunity to launch Kubeflow, that is ok! You can deploy Kubeflow easily using Microk8s by following the tutorial – Deploy Kubeflow on Ubuntu, Windows and MacOS. We recommend deploying Kubeflow on your workstation if you have a machine with 16GB of RAM or more. Otherwise, spin up a virtual machine with these resources (e.g. t2.xlarge EC2 instance) and…


Previous Cannot update 20.04 without system breaking
Next [xubuntu] Unable to install Tellico

About author

Sibananda Sahu
Sibananda Sahu 149 posts

A Linux Kernel Developer and a Firmware Developer by profession. Have worked with few big companies: BROADCOM Corporation, Cypress Semiconductor, LSI Corporation, TOSHIBA Corporation, Western Digital; on various cutting edge technologies and product lines, such as: RAID storage Driver, SSD Firmware, WLAN Firmware etc. Having more than 9 years of experience in Software Engineering domain. Now, took a pledge to educate all aspirant students to teach about Linux Kernel Development.

View all posts by this author →

You might also like

Ubuntu Dsicussions 0 Comments

[ubuntu] Library Double Standards

I decided to borrow a few books from the library. You would think being into making books available free of charge they would embrace software with a very similar philosophy.

Ubuntu Dsicussions 0 Comments

Target Sources (main/source/Sources) is configured multiple times in /etc/apt/source

Hi, I have upgraded my ubuntu from 16.04 to 20.04, and I am getting numerous problems, here is one. Code: apt update gives, Code: Fetched 33,0 MB in 16s (2 071

Ubuntu Dsicussions 0 Comments

[ubuntu_studio] Software center update stalled ? Snap ?

As a usual software update was near complete the notification stalled on ‘snap ?’ I then noticed that the software center had gone. can’t seem to install it as it


No Comments Yet!

You can be first to comment this post!

Leave a Reply