Category Archives: Data Science
Machine Learning – Training, Validation & Test Data Set
![Training, validation and test data set](https://vitalflux.com/wp-content/uploads/2021/06/training_validation_and_test_data_set-300x221.jpg)
In this post, you will learn about the concepts of training, validation, and test data sets used for training machine learning models. The post is most suitable for data science beginners or those who would like to get clarity and a good understanding of training, validation, and test data sets concepts. The following topics will be covered: Data split – training, validation, and test data set Different model performance based on different data splits Data Splits – Training, Validation & Test Data Sets You can split data into the following different sets and each data split configuration will have machine learning models having different performance: Training data set: When you …
Why use Random Seed in Machine Learning?
![random seed value generator](https://vitalflux.com/wp-content/uploads/2021/06/random-seed-value-generator-300x202.jpg)
In this post, you will learn about why and when do we use random seed values while training machine learning models. This is a question most likely asked by beginners data scientist/machine learning enthusiasts. We use random seed value while creating training and test data set. The goal is to make sure we get the same training and validation data set while we use different hyperparameters or machine learning algorithms in order to assess the performance of different models. This is where the random seed value comes into the picture. Different Python libraries such as scikit-learn etc have different ways of assigning random seeds. While training machine learning models using Scikit-learn, …
Precision & Recall Explained using Covid-19 Example
![Model precision recall accuracy as function of Covid19](https://vitalflux.com/wp-content/uploads/2021/04/Model-precision-recall-accuracy-as-function-of-Covid19-300x197.jpg)
In this post, you will learn about the concepts of precision, recall, and accuracy when dealing with the machine learning classification model. Given that this is Covid-19 age, the idea is to explain these concepts in terms of a machine learning classification model predicting whether the patient is Corona positive or not based on the symptoms and other details. The following model performance concepts will be described with the help of examples. What is the model precision? What is the model recall? What is the model accuracy? What is the model confusion matrix? Which metrics to use – Precision or Recall? Before getting into learning the concepts, let’s look at the data (hypothetical) derived out …
Actionable Insights Examples – Turning Data into Action
![data to insights to action - actionable insights examples](https://vitalflux.com/wp-content/uploads/2021/02/data-to-insights-to-action-300x119.png)
In this post, you will learn about how to turn data into information and then to actionable insights with the help of few examples. It will be helpful for data analysts, data scientists, and business analysts to get a good understanding of what is actionable insight? You will understand aspects related to data-driven decision making. Before getting into the details, let’s understand what is the problem at hand? The school authority is trying to assess and improve the health of students. Here is the question it is dealing with: How could we improve the overall health of the students in the school? We will look into the approach of finding the …
When to use Deep Learning vs Machine Learning Models?
![](https://vitalflux.com/wp-content/uploads/2021/01/machine-learning-vs-deep-learning-300x200.png)
In this post, you will learn about when to go for training deep learning models from the perspective of model performance and volume of data. As a machine learning engineer or data scientist, it always bothers as to can we use deep learning models in place of traditional machine learning models trained using algorithms such as logistic regression, SVM, tree-based algorithms, etc. The objective of this post is to provide you with perspectives on when to go for traditional machine learning models vs deep learning models. The two key criteria based on which one can decide whether to go for deep learning vs traditional machine learning models are the following: …
Most Common Types of Machine Learning Problems
![](https://vitalflux.com/wp-content/uploads/2020/12/machine_learning_mind_map_6-300x187.png)
In this post, you will learn about the most common types of machine learning (ML) problems along with a few examples. Without further ado, let’s look at these problem types and understand the details. Regression Classification Clustering Time-series forecasting Anomaly detection Ranking Recommendation Data generation Optimization Problem types Details Algorithms Regression When the need is to predict numerical values, such kinds of problems are called regression problems. For example, house price prediction Linear regression, K-NN, random forest, neural networks Classification When there is a need to classify the data in different classes, it is called a classification problem. If there are two classes, it is called a binary classification problem. …
Historical Dates & Timeline for Deep Learning
![deep learning timeline](https://vitalflux.com/wp-content/uploads/2021/01/deep-learning-timeline-300x159.png)
This post is a quick check on the timeline including historical dates in relation to the evolution of deep learning. Without further ado, let’s get to the important dates and what happened on those dates in relation to deep learning: Year Details/Paper Information Who’s who 1943 An artificial neuron was proposed as a computational model of the “nerve net” in the brain. Paper: “A logical calculus of the ideas immanent in nervous activity,” Bulletin of Mathematical Biophysics, volume 5, 1943 Warren McCulloch, Walter Pitts Late 1950s A neural network application by reducing noise in phone lines was developed Paper: Andrew Goldstein, “Bernard Widrow oral history,” IEEE Global History Network, 1997 Bernard …
Great Mind Maps for Learning Machine Learning
![machine learning mind map](https://vitalflux.com/wp-content/uploads/2020/12/machine_learning_mind_map_3-300x215.png)
In this post, you will get to look at some of the great mind-maps for learning different machine learning topics. I have gathered these mind maps from different web pages on the Internet. The idea is to reinforce our understanding of different machine learning topics using pictures. You may have heard the proverb – A picture is worth a thousand words. Keeping this in mind, I thought to pull some of the great mind maps posted on different web pages. I would be updating this blog post from time-to-time. If you are a beginner data scientist or an experienced one, you may want to bookmark this page for refreshing your …
Different Types of Distance Measures in Machine Learning
![Euclidean Distance formula](https://vitalflux.com/wp-content/uploads/2020/12/Euclidean-Distance-formula-2-300x245.png)
In this post, you will learn different types of distance measures used in different machine learning algorithms such as K-nearest neighbours, K-means etc. Distance measures are used to measure the similarity between two or more vectors in multi-dimensional space. The following represents different forms of distance metrics / measures: Geometric distances Computational distances Statistical distances Geometric Distance Measures Geometric distance metrics, primarily, tends to measure the similarity between two or more vectors solely based on the distance between two points in multi-dimensional space. The examples of such type of geometric distance measures are Minkowski distance, Euclidean distance and Manhattan distance. One other different form of geometric distance is cosine similarity which will discuss …
Machine Learning Terminologies for Beginners
![ML Terminologies Hypothesis Space](https://vitalflux.com/wp-content/uploads/2020/12/ML-Terminologies-Hypothesis-Space-300x281.png)
When starting on the journey of learning machine learning and data science, we come across several different terminologies when going through different articles/posts, books & video lectures. Getting a good understanding of these terminologies and related concepts will help us understand these concepts in a nice manner. At a senior level, it gets tricky at times when the team of data scientists / ML engineers explain their projects and related outcomes. With this in context, this post lists down a set of commonly used machine learning terminologies that will help us get a good understanding of ML concepts and also engage with the DS / AI / ML team in …
Machine Learning Free Course at Univ Wisconsin Madison
![Dr Sebastian Raschka Machine Learning Course](https://vitalflux.com/wp-content/uploads/2020/12/Dr-Sebastian-Raschka-300x250.png)
In this post, you will learn about the free course on machine learning (STAT 451) recently taught at University of Wisconsin-Madison by Dr. Sebastian Raschka. Dr. Sebastian Raschka in currently working as an assistant Professor of Statistics at the University of Wisconsin-Madison while focusing on deep learning and machine learning research. The course is titled as “Introduction to Machine Learning”. The recording of the course lectures can be found on the page – Introduction to machine learning. The course covers some of the following topics: What is machine learning? Nearest neighbour methods Computational foundation Python Programming (concepts) Machine learning in Scikit-learn Tree-based methods Decision trees Ensemble methods Model evaluation techniques Concepts of …
MIT Free Course on Machine Learning (New)
![MIT Free Course on Machine Learning](https://vitalflux.com/wp-content/uploads/2020/12/Screenshot-2020-12-15-at-9.00.14-AM-300x200.png)
In this post, the information regarding new free course on machine learning launched by MIT OpenCourseware. In case, you are a beginner data scientist or ML Engineer, you will find this course to be very useful. Here is the URL to the free course on machine learning: https://bit.ly/37iNNAA. This course, titled as Introduction to Machine Learning, introduces principles, algorithms, and applications of machine learning from the point of view of modeling and prediction. It includes formulation of learning problems and concepts of representation, over-fitting, and generalization. These concepts are exercised in supervised learning and reinforcement learning, with applications to images and to temporal sequences. Here are some of the key topics for which lectures can be found: …
Gradient Boosting Regression Python Examples
![Gradient Boosting Regressor Feature Importances](https://vitalflux.com/wp-content/uploads/2020/12/Screenshot-2020-12-14-at-10.58.05-AM-1-300x283.png)
In this post, you will learn about the concepts of Gradient Boosting Regression with the help of Python Sklearn code example. Gradient Boosting algorithm is one of the key boosting machine learning algorithms apart from AdaBoost and XGBoost. What is Gradient Boosting Regression? Gradient Boosting algorithm is used to generate an ensemble model by combining the weak learners or weak predictive models. Gradient boosting algorithm can be used to train models for both regression and classification problem. Gradient Boosting Regression algorithm is used to fit the model which predicts the continuous value. Gradient boosting builds an additive mode by using multiple decision trees of fixed size as weak learners or …
Data Quality Challenges for Analytics Projects
![data quality challenges for analytics projects](https://vitalflux.com/wp-content/uploads/2020/12/Screenshot-2020-12-11-at-6.48.09-PM-300x210.png)
In this post, you will learn about some of the key data quality challenges which you may need to tackle with, if you are working on data analytics projects or planning to get started on data analytics initiatives. If you represent key stakeholders in analytics team, you may find this post to be useful in understanding the data quality challenges. Here are the key challenges in relation to data quality which when taken care would result in great outcomes from analytics projects related to descriptive, predictive and prescriptive analytics: Data accuracy / validation Data consistency Data availability Data discovery Data usability Data SLA Cos-effective data Data Accuracy One of the most important …
Data Science vs Data Engineering Team – Have Both?
![Data engineering vs Data Science](https://vitalflux.com/wp-content/uploads/2020/12/Screenshot-2020-12-11-at-10.38.21-AM-300x176.png)
In this post, you will learn about different aspects of data science and data engineering team and also understand the key differences between them. As data science / engineering stakeholders, it is very important to understand whether we need to have one or both the teams to achieve high quality dataset & data pipelines as well as high-performant machine learning models. Background When an organization starts on the journey of building data analytics products, primarily based on predictive analytics, it goes on to set up a centralized (mostly) data science team consisting of data scientists. The data science team works with the product team or multiple product teams to gather the …
500+ Machine Learning Interview Questions
![machine learning interview questions](https://vitalflux.com/wp-content/uploads/2017/11/quiz2-300x150.png)
This post consists of all the posts on this website in relation to interview questions / quizzes related to data science / machine learning topics. These questions can prove to be helpful for the following: Product managers Data scientists Product Managers Interview Questions Find the questions for product managers on this page – Machine learning interview questions for product managers Data Scientists Interview Questions Here are posts representing 500+ interview questions which will be helpful for data scientists / machine learning engineers. You will find it useful as practise questions and answers while preparing for machine learning interview. Decision tree questions Machine learning validation techniques questions Neural networks questions – …
I found it very helpful. However the differences are not too understandable for me