Relu Variants Explained | Leaky Relu | Parametric Relu | Elu | Selu | Activation Functions Part 2
Channel: CampusX
Date: 2022-06-09

This is part 2 of the Activation Function Series. In this video, we will discuss the dying relu problem and then learn about the following variants of Relu activation function:

1. Leaky Relu
2. Parametric Relu
3. Elu
4. Selu

Digital Notes for Deep Learning: https://shorturl.at/NGtXg

👍If you find this video helpful, consider giving it a thumbs up and subscribing for more educational videos on data science! Share your thoughts, experiences, or questions in the comments below. I love hearing from you!

============================
Do you want to learn from me?
Check my affordable mentorship program at : https://learnwith.campusx.in
============================

📱 Grow with us:
CampusX' LinkedIn: https://www.linkedin.com/company/campusx-official
CampusX on Instagram for daily tips: https://www.instagram.com/campusx.official
My LinkedIn: https://www.linkedin.com/in/nitish-singh-03412789
Discord: https://discord.gg/PsWu8R87Z8

✨ Hashtags✨
#ActivationFunctions #ReluVariants #NeuralNetworksExplained

⌚Time Stamps⌚

00:00 - Intro
00:44 - Dying Relu Problem
17:12 - Solutions
20:05 - Leaky Relu
22:47 - Advantages
24:29 - Parametric Relu
25:44 - Exponential Linear Unit
28:40 - Disadvantages
29:09 - Scaled Exponential Linear Unit
33:00 - Outro