Phytoestrogens, which are found in soy products, can affect sperm motility and production. While moderate soy product consumption is usually considered safe, restricting intake may be advantageous if you're trying to get pregnant.