There is no evidence that sperm can make you fat. In fact, if anything, sperm may help you lose weight. A study published in the journal PLoS One found that when men who were overweight or obese ate a healthy diet and exercised regularly, their sperm quality improved.