What is exactly the attention mechanism introduced to RNN -LRB- recurrent neural network -RRB- ? It would be nice if you could make it easy to understand !
Is Hebbian learning mechanism is essential to learn for better understanding artificial neural network ? Is it okay to skip Hebbian mechanism ?