No. Infertility can affect both genders. Women may be unable to conceive due to various reasons including hormonal issues. However, even men may suffer from infertility issues like low sperm count and may be unable to impregnate a woman.