Probably not. Your family history is not the biggest factor that can impart your fertility. In men, low sperm count and motility are culprits for infertility. Men this can carry disorders in his offsprings due to the lack of Y chromosomes. However, experts are also not sure about this problem. If you are not getting pregnant even after one year of intercourse, must seek fertility doctor advice.