The dazzling domain of duals | Introduction to Machine Learning | CS771
Channel: ML Conversations
Date: 16/02/2023

A look at the technique of creating dual optimization problems to handle constraints
Developed as a part of the course CS771 Introduction to Machine Learning offered at IIT Kanpur.


TIMESTAMPS
-----------------------
00:00 - Introduction
01:09 - The Lagrangian
04:36 - The dual problem
08:31 - Example 1: ridge regression
10:45 - A bit of gyan
12:04 - The QUIN trick
12:49 - Example 2: elastic net
18:33 - Exercise
19:15 - Summary


CORRECTIONS
------------------------
06:50  The text on the slide is correct but I misspoke -- if all the constraints are satisfied, then maximizing the Lagrangian over the dual variables will give the value of the original objective function, not zero. Sorry for the slip of tongue :P


CONTENT
----------------
Original slides, code and notes available on GitHub
https://github.com/purushottamkar/cs771

Slides and animations developed using Microsoft PowerPoint
Video recorded using OBS Studio and edited using Shotcut
https://obsproject.com/
https://shotcut.org/

Intro sting and outro music: TFB9 by Vibe Tracks
https://music.youtube.com/watch?v=c5hRwY_nEg4

Emoticons from Flaticon, designed by Twitter
https://www.flaticon.com/packs/smileys-and-people-9
Licensed under CC BY 3.0

Fonts
Sifonn by Rafa Goicoechea
Calibri by Luc(as) de Groot


ABOUT THIS CHANNEL
--------------------------------------
ML Conversations is a space to discuss about machine learning and its myriad applications.
Check out our channel here: https://www.youtube.com/c/MLConversations
To stay posted on new videos, subscribe and click the bell if you wish to receive notifications as well.