There are many things that we can blame a loss of sex drive on, but the most common reasons include working too much, working a desk job where you sit all day, technology, and hormone imbalances. Too much stress and too much demand on your mental and physical energy results in the depletion of your adrenal glands, the powerhouse glands that are responsible for the output of your stress hormones and most of your testosterone, which is where that desire for sex comes from.