Attention in Neural Networks
Channel: CodeEmporium
Date: 2018-03-02

In this video, we discuss Attention in neural networks. We go through Soft and hard attention, discuss the architecture with examples. SUBSCRIBE to the channel for more awesome content! 

My video on Generative Adversarial Networks: https://www.youtube.com/watch?v=O8LAi6ksC80
My video on Convolution Neural Networks: https://www.youtube.com/watch?v=m8pOnJxOcqY

INVESTING
[1] Webull (You can get 3 free stocks setting up a webull account today): https://a.webull.com/8XVa1znjYxio6ESdff

REFERENCES
Show attend and tell (Image Captioning): https://arxiv.org/pdf/1502.03044.pdf
What is attention: https://blog.heuritech.com/2016/01/20/attention-mechanism/
Attention is all you need: https://arxiv.org/pdf/1706.03762v5.pdf
Nice blog on Attention: http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/
Feed Forward + Attention can solve problems: https://arxiv.org/pdf/1512.08756.pdf
Teaching Machines to Read and Comprehend: https://arxiv.org/pdf/1506.03340.pdf