Prolonged periods of stress can deplete serotonin levels. Our fast-paced, fast food society greatly contributes to these imbalances. Genetic factors, faulty metabolism, and digestive issues can impair the absorption and breakdown of our food which reduces our ability to build serotonin. Poor Diet.