Assimilative Memory: Or How To Attend and Never Forget