Count is not the only indicator of normalcy. A normal sperm count, with a abnormal sperm forms, or a higher percentage of dead sperms, may also lead to infertility.
If all parameters in a sperm exam are normal, your partner should get tested using ultrasound, as well as blood tests for optimal ovum production.