Yes, stress can kill your brain cells. It has a shrinking effect on the prefrontal cortex, the area of the brain responsible for memory and learning.