Decreased sexual activity or desire can lead to a drop in serum testosterone in older men. Over 2 years, men with plummeting serum concentrations of testosterone have higher odds of experiencing a notable decrease in sexual desire and activity. In older men, lack of sex can be a cause – not an effect – of reduced circulating testosterone.