Yes, varicocele can damage sperm and reduce fertility in men. It can cause a decrease in sperm count, motility, and morphology, as well as an increase in DNA damage to sperm.