Experts believe several factors can increase the risk of diffuse memory loss. This is partly because the risk is cumulative, meaning it increases as a person has more risk factors. If the trauma is longer, repeated, or more severe, it usually worsens the condition.