Starvation's effect on physiological health includes hypogonadism, or the failure of the ovaries to function properly. Reduced levels of hormones actually related to sexual functioning — including estrogen and progesterone, which the ovaries produce — can easily affect your sex drive.