In your 40s, menopause leads to more breast changes as your ovaries start to produce less estrogen. At this point, your breasts go through what's called involution, which is when the breast tissue is replaced by fat, which is softer, so they don't feel as firm, says Jacobs.