Machine Learning Tutorial Chap 5| Part-3 L2 Regularization | Rohit Ghosh Machine Learning | GreyAtom
Channel: GreyAtom EduTech
Date: 07/06/2019

Welcome to the #DataScienceFridays Rohit Ghosh, a deep learning scientist, and an Instructor at GreyAtom will take us through polynomial regression in machine learning through a simple introduction series. 

Regularization is a way to avoid overfitting by penalizing high-valued regression coefficients. In simple terms, it reduces parameters and shrinks (simplifies) the model. This more streamlined, more parsimonious model will likely perform better at predictions. Regularization adds penalties to more complex models and then sorts potential models from least overfit to greatest; The model with the lowest “overfitting” score is usually the best choice for predictive power.  

Regularization works by biasing data towards particular values (such as small values near zero). The bias is achieved by adding a tuning parameter to encourage those values:

            L1 regularization adds an L1 penalty equal to the absolute value of the magnitude of coefficients. In other words, it limits the size of the coefficients. L1 can yield sparse models (i.e. models with few coefficients); Some coefficients can become zero and eliminated. Lasso regression uses this method.
  
           L2 regularization adds an L2 penalty equal to the square of the magnitude of coefficients. L2 will not yield sparse models and all coefficients are shrunk by the same factor (none are eliminated). Ridge regression and SVMs use this method.

 L2 in Machine Learning through this introductory session for beginners. 

This is the 3rd in 4 videos about Advance Linear Regression in Machine Learning. 

In this video, we will explore the limitations of linear regression and need of polynomial regression in machine learning. 

Complete Playlist for the Course: https://bit.ly/2Q1zvK6 

After completing our 4-part Series on Polynomial Regression in Machine Learning, you will be able to do the following:

Understand the various problems of Linear Regression
Learn about ways to handle Non-Linear Data
Understand Regularization and its types
Distinguish between L1 and L2
Understand Bias-Variance Trade-off
Learn about Model Validation


Here’s the full syllabus of our 4-part video on Polynomial Regression in Machine Learning:


Limitations of linear regression 
Polynomial Basis Function
Regularization in machine learning
     - L1 Regularization
     - L2 Regularization
     - L1 vs L2
     - Elastic Net Regularization
Bias-variance trade-off
Model Validation

#machinelearningtutorial #polynomialregression #DataScience101 #Greyatom

Please feel free to post your doubts, questions, feedback in the Comments section and we will sure to get back to you.