02 – Neural nets: rotation and squashing
Channel: Alfredo Canziani
Date: 24/02/2021

Course website: http://bit.ly/DLSP21-web
Playlist: http://bit.ly/DLSP21-YouTube
Speaker: Alfredo Canziani

Chapters
00:00 – Welcome!
02:30 – Affine transformations and non-linearities
03:42 – Affine transformation: intuition
13:47 – Summary slide
14:06 – Jupyter and PyTorch
18:47 – Input data
24:39 – Coding a 2×2 linear transformation & Gilbert Strang
30:15 – Coding a  2×2 linear transformation w/ PyTorch
33:03 – Hyperbolic tangent
47:02 – Rotation + squashing + rotation: ooooh, a neural net
49:28 – Rectifying linear unit (ReLU)
51:10 – Shoutout to @vcubingx and his animation
52:09 – Spiky transformation: what happen here?
54:23 – A *very deep* neural net
56:30 – A deep net with tanh
56:43 – Summary of today lesson