Before revision: We show that the transformer attention mechanism is the update rule of a modern Hopfield network with continuous states .
After revision: We introduce a modern Hopfield network with continuous states .