In some cases, sperm count may increase if an underlying condition can be identified and treated. However, the following dietary and lifestyle changes can also help a man increase his sperm count: Eat a healthy diet rich in fresh fruits, vegetables, and whole grains. Replace animal fats with monounsaturated oils, such as olive oil. Certain specific nutrients and vitamins have been studied for their effects on male infertility and sperm health.