While lifestyle changes alone may not completely reverse low sperm count, they can significantly improve overall fertility health. Quitting smoking, reducing alcohol intake, managing stress, exercising regularly and maintaining a healthy weight are all steps you can take to enhance sperm count.