Machine Learning

How to Setup / Install MLFlow & Get Started

In this post, you will learn about how to setup / install MLFlow right from your Jupyter Notebook and get started tracking your machine learning projects. This would prove to be very helpful if you are running an enterprise-wide AI practice where you have a bunch of data scientists working on different ML projects. Mlflow will help you track the score of different experiments related to different ML projects.

Install MLFlow using Jupyter Notebook

In order to install / set up MLFlow and do a quick POC, you could get started right from within your Jupyter notebook. Here are the commands to get set up. Mlflow could be installed with simple command: pip install mlflow. Within Jupyter notebook, this is what you would do:

#
# Install MLFLow using PIP Install
#
!pip install mlflow
#
# Check whether MLFlow installed by accessing its version
#
!mlflow --version

Executing above commands would set up MLFlow and print its version. It printed this for me: mlflow, version 1.11.0

Next step is to start MLFlow UI. Here is the command to get started with MLFlow UI from within Jupyter Notebook

#
# Mlflow UI
#
!mlflow ui

You could as well execute the command, mlflow ui, in the command prompt and it would start the server at URL such as http://127.0.0.1:5000/. This is how the Mlflow UI would look like:

Fig 1. MLFlow UI Application

Next step is to run some experiments in form of training a model. The goal is to track the model runs in MLFlow UI.

Run Experiments / Train Model & Track using MLFlow UI

In order to getting started with training model and tracking model scores / experiment outcomes using MLFlow, I would suggest you take a look at this POC.

Download the MLFlow sample code from this MLFlow github page: https://github.com/mlflow/mlflow. You can train a simplistic logistic regression model using the code given below. This could can be found in the following folder in the downloaded code (examples/sklearn_logistic_regression/train.py).

import numpy as np
from sklearn.linear_model import LogisticRegression

import mlflow
import mlflow.sklearn

if __name__ == "__main__":
    X = np.array([-2, -1, 0, 1, 2, 1]).reshape(-1, 1)
    y = np.array([0, 0, 1, 1, 1, 0])
    lr = LogisticRegression()
    lr.fit(X, y)
    score = lr.score(X, y)
    print("Score: %s" % score)
    mlflow.log_metric("score", score)
    mlflow.sklearn.log_model(lr, "model")
    print("Model saved in run %s" % mlflow.active_run().info.run_uuid)

All this is required to be done is to add the below code to your machine learning model training code and execute with Python. This would make sure that MLflow runs can be recorded to local file. You could as well record the MLFlow runs on remote server. To log ML project runs remotely, you will need to set the MLFLOW_TRACKING_URI environment variable to the tracking server’s URI. The code below is executed from within Jupyter notebook.

!python /Users/apple/Downloads/mlflow-master/examples/sklearn_logistic_regression/train.py

This will output the following shown as a screenshot:

Fig 2. MLFlow sample run output

The above run could now be accessed in MLFlow UI.

Fig 3. Tracking MLFLow project

You could learn more about MLFlow on MLFLow concept page.

Conclusions

Here is the summary of what you learned in this post in relation to setting up / installing MLFlow and getting started:

  • MLflow can be installed simply with command such as pip install mlflow.
  • Mlflow UI can be started using command such as mlflow ui
  • Machine learning model training logs can be written by using MLFlow APIs / methods in the model training code.
  • MLflow runs can be recorded to local files, to a SQLAlchemy compatible database, or remotely to a tracking server.
Ajitesh Kumar

I have been recently working in the area of Data analytics including Data Science and Machine Learning / Deep Learning. I am also passionate about different technologies including programming languages such as Java/JEE, Javascript, Python, R, Julia, etc, and technologies such as Blockchain, mobile computing, cloud-native technologies, application security, cloud computing platforms, big data, etc. I would love to connect with you on Linkedin. Check out my latest book titled as First Principles Thinking: Building winning products using first principles thinking.

Recent Posts

Agentic Reasoning Design Patterns in AI: Examples

In recent years, artificial intelligence (AI) has evolved to include more sophisticated and capable agents,…

1 month ago

LLMs for Adaptive Learning & Personalized Education

Adaptive learning helps in tailoring learning experiences to fit the unique needs of each student.…

1 month ago

Sparse Mixture of Experts (MoE) Models: Examples

With the increasing demand for more powerful machine learning (ML) systems that can handle diverse…

2 months ago

Anxiety Disorder Detection & Machine Learning Techniques

Anxiety is a common mental health condition that affects millions of people around the world.…

2 months ago

Confounder Features & Machine Learning Models: Examples

In machine learning, confounder features or variables can significantly affect the accuracy and validity of…

2 months ago

Credit Card Fraud Detection & Machine Learning

Last updated: 26 Sept, 2024 Credit card fraud detection is a major concern for credit…

2 months ago