Deep attention updates