Weight Initialization Techniques | What not to do? | Deep Learning
Channel: CampusX
Date: 2022-06-23

In this video, I'll guide you through weight initialization techniques in neural networks and highlight what NOT to do. From common mistakes to misconceptions, I'll help you navigate the dos and don'ts in optimizing your network's performance.

Digital Notes for Deep Learning: https://shorturl.at/NGtXg

🧑‍💻Code:
https://colab.research.google.com/drive/1M4q5yRA0iQXh9h8Y3J7zFGIQzO_Pv9n0?usp=sharing

https://colab.research.google.com/drive/1bsVRmTjYjiQUFee3REHCYeY3vv5r7nfH?usp=sharing

Viz Tool:
https://www.deeplearning.ai/ai-notes/initialization/

============================
Do you want to learn from me?
Check my affordable mentorship program at : https://learnwith.campusx.in
============================

📱 Grow with us:
CampusX' LinkedIn: https://www.linkedin.com/company/campusx-official
CampusX on Instagram for daily tips: https://www.instagram.com/campusx.official
My LinkedIn: https://www.linkedin.com/in/nitish-singh-03412789
Discord: https://discord.gg/PsWu8R87Z8

👍If you find this video helpful, consider giving it a thumbs up and subscribing for more educational videos on data science!

💭Share your thoughts, experiences, or questions in the comments below. I love hearing from you!

✨ Hashtags✨
#WeightInitialization #DeepLearningTips #NeuralNetworks 

⌚Time Stamps⌚

00:00 - Intro
01:02 - Why weight initialization is important?
04:31 - Case 1
11:16 - Code Example
14:25 - Sigmoid
23:47 - Code Example
26:52 - Case 2
30:34 - Code Example
32:08 - Case 3
41:04 - Code Example
42:43 - RELU
43:55 - Random Initialization (Large Values)
49:07 - Outro