Erectile dysfunction does not directly impact your fertility, but it can make it difficult to conceive a baby.