There's no scientific consensus that coffee directly decreases libido. Studies on caffeine and sex drive are inconsistent; some suggest that a moderate amount of caffeine can stimulate the libido, while others point to potential adverse effects when consumed in large quantities.