Machine Learning – When to Use Linear vs Guassian Kernel with SVM

0
This article represents guidelines which could be used to decide whether to use Linear kernel or Gaussian kernel when working with Support Vector Machine (SVM). Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos.

Following are the key points described later in this article:

  • When to Use Linear Kernel
  • When to Use Gaussian Kernel

 

When to Use Linear Kernel

In case there are large number of features and comparatively smaller number of training examples, one would want to use linear kernel. As a matter of fact, it can also be called as SVM with No Kernel. One may recall that SVM with no kernel acts pretty much like logistic regression model where following holds true:

  • Predict Y = 1 when W.X >= 0. Note that, in the prior equation, W is actually W transpose and also includes bias factor.
  • Predict Y = 0 when W.X < 0.

Simply speaking, one may want to use SVM with linear kernel when data distribution is linearly separable.

 

When to Use Gaussian Kernel

In scenarios, where there are smaller number of features and large number of training examples, one may use what is called Gaussian Kernel. When working with Gaussian kernel, one may need to choose the value of variance (sigma square). The selection of variance would determine the bias-variance trade-offs. Higher value of variance would result in High bias, low variance classifier and, lower value of variance would result in low bias/high variance classifier.

 

Ajitesh Kumar

Ajitesh Kumar

Ajitesh has been recently working in the area of AI and machine learning. Currently, his research area includes Safe & Quality AI. In addition, he is also passionate about various different technologies including programming languages such as Java/JEE, Javascript and technologies such as Blockchain, mobile computing, cloud-native technologies, application security, cloud computing platforms, big data etc.

He has also authored the book, Building Web Apps with Spring 5 and Angular.
Ajitesh Kumar

Leave A Reply

Time limit is exhausted. Please reload the CAPTCHA.