Up until roughly the age of 55, most men continue to put on weight even if they begin to lose weight later in life. This may be connected to a decrease in testosterone, which is a hormone associated with male sexuality. After the age of 65, women typically start to lose weight, having gained it up to that point.