Yes, as men age, their sperm count and quality can decline. However, age is not the only factor that affects sperm count, and older men can have healthy sperm counts.