Severe stress, depression, a vitamin B12 deficiency, too little or too much sleep, some prescription drugs and infections can all play a role. Even if those factors don't explain your memory lapses, you don't need to simply resign yourself to memory loss as you age.