Practical 2.1 – NN backward
Channel: Alfredo Canziani
Date: 2016-08-29

Neural Networks – back propagation (training)
Full project: https://github.com/Atcold/torch-Video-Tutorials

Notes:
09:08 – 𝓛(ϴ) can be written as J(ϴ) or J(θ)
37:55 – in equation v), a⁽ˡ⁾ should be â⁽ˡ⁾
40:54 – some transpositions are missing: ϴ → ϴ + ηδâᵀ (check next video for an in-depth explanation)
41:50 – same as above (the term 1/m is optional): ϴ → ϴ + η/m Σ δâᵀ