In this post, you will learn about how to setup / install MLFlow right from your Jupyter Notebook and get started tracking your machine learning projects. This would prove to be very helpful if you are running an enterprise-wide AI practice where you have a bunch of data scientists working on different ML projects. Mlflow will help you track the score of different experiments related to different ML projects.
In order to install / set up MLFlow and do a quick POC, you could get started right from within your Jupyter notebook. Here are the commands to get set up. Mlflow could be installed with simple command: pip install mlflow. Within Jupyter notebook, this is what you would do:
#
# Install MLFLow using PIP Install
#
!pip install mlflow
#
# Check whether MLFlow installed by accessing its version
#
!mlflow --version
Executing above commands would set up MLFlow and print its version. It printed this for me: mlflow, version 1.11.0
Next step is to start MLFlow UI. Here is the command to get started with MLFlow UI from within Jupyter Notebook
#
# Mlflow UI
#
!mlflow ui
You could as well execute the command, mlflow ui, in the command prompt and it would start the server at URL such as http://127.0.0.1:5000/. This is how the Mlflow UI would look like:
Next step is to run some experiments in form of training a model. The goal is to track the model runs in MLFlow UI.
In order to getting started with training model and tracking model scores / experiment outcomes using MLFlow, I would suggest you take a look at this POC.
Download the MLFlow sample code from this MLFlow github page: https://github.com/mlflow/mlflow. You can train a simplistic logistic regression model using the code given below. This could can be found in the following folder in the downloaded code (examples/sklearn_logistic_regression/train.py).
import numpy as np
from sklearn.linear_model import LogisticRegression
import mlflow
import mlflow.sklearn
if __name__ == "__main__":
X = np.array([-2, -1, 0, 1, 2, 1]).reshape(-1, 1)
y = np.array([0, 0, 1, 1, 1, 0])
lr = LogisticRegression()
lr.fit(X, y)
score = lr.score(X, y)
print("Score: %s" % score)
mlflow.log_metric("score", score)
mlflow.sklearn.log_model(lr, "model")
print("Model saved in run %s" % mlflow.active_run().info.run_uuid)
All this is required to be done is to add the below code to your machine learning model training code and execute with Python. This would make sure that MLflow runs can be recorded to local file. You could as well record the MLFlow runs on remote server. To log ML project runs remotely, you will need to set the MLFLOW_TRACKING_URI
environment variable to the tracking server’s URI. The code below is executed from within Jupyter notebook.
!python /Users/apple/Downloads/mlflow-master/examples/sklearn_logistic_regression/train.py
This will output the following shown as a screenshot:
The above run could now be accessed in MLFlow UI.
You could learn more about MLFlow on MLFLow concept page.
Here is the summary of what you learned in this post in relation to setting up / installing MLFlow and getting started:
In recent years, artificial intelligence (AI) has evolved to include more sophisticated and capable agents,…
Adaptive learning helps in tailoring learning experiences to fit the unique needs of each student.…
With the increasing demand for more powerful machine learning (ML) systems that can handle diverse…
Anxiety is a common mental health condition that affects millions of people around the world.…
In machine learning, confounder features or variables can significantly affect the accuracy and validity of…
Last updated: 26 Sept, 2024 Credit card fraud detection is a major concern for credit…