Lec 24: Banach Contraction Mapping Theorem and Convergence Analysis
Channel: Abhishek Gupta
Date: 2021-11-01

In this lecture on Nonlinear Programming, we explore the Banach Contraction Mapping Theorem and its application to the convergence of optimization algorithms. We will cover the basics of the theorem, how it applies to optimization problems, and how it can be used to analyze the convergence of iterative optimization algorithms. Join us for a deep dive into the mathematical foundations of optimization algorithms and learn how to leverage the Banach Contraction Mapping Theorem for estbalishing convergence of optimization algorithms.

This lecture series is from the Nonlinear Programming course that ran at The Ohio State University under the course number ECE 5759. The course builds on linear algebra and calculus to derive various algorithms for optimization in static and dynamic systems. The course is aimed at first-year graduate students, though senior undergraduate students with advanced knowledge of mathematics can also grasp the concepts discussed in the course. 
If you are interested in other courses taught by him, you can view them here:

Cybersecurity of Autonomous Systems (aimed at early graduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJtMXvdpMD73okhm-MqQHqx0

Reinforcement Learning (aimed at very advanced PhD students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJs1tCLQnlnSRsOJArj_cP9u

Game Theory and Mechanism Design (aimed at early PhD students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJtEJrafhk9tb3E5qQRGHvCK

Signals and Systems (aimed at third year undergraduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJuloGWq7YqhvQ9KV1ltwY8r

Feedback Control Systems (aimed at fourth year undergraduate students): https://www.youtube.com/playlist?list=PL_Nk3YvgORJv1sgMhuKZ-mlcidfLDl4zy

Prof. Abhishek Gupta is an Associate Professor in the Electrical and Computer Engineering department at The Ohio State University. He completed his Ph.D. in Aerospace Engineering (2014), MS in Applied Mathematics (2012), and MS in Aerospace Engineering (2011), all from University of Illinois at Urbana-Champaign (UIUC). Before coming to UIUC in 2009, he completed his undergraduate in Aerospace Engineering from Indian Institute of Technology, Bombay, India (2005-09). As part of his research, he contributes to probability theory, optimization methods, and practice of data-driven algorithms in various applications. He has developed theory to ascertain convergence of recursive stochastic algorithms. He has devised new algorithms to detect cyberattacks on autonomous systems, price transportation services, optimize fuel efficiency in vehicles, and optimize charging of electric vehicles using renewable energy.  His research has resulted in over 60 peer reviewed publications, 1 patent, and 2 pending patents. You can find more information about him and his research at https://gupta706.github.io/.