Although most men are able to have children well into their 50s and beyond, it becomes gradually more difficult after the age of 40 . There are many reasons for this, including: Sperm quality tends to decrease with age.