Remember Not to Forget