No, not all molds are harmful. In fact, only a few molds can seriously hinder a human's immune system. Some molds can cause infections in people who have compromised immune systems. Those who have asthma also tend to suffer from mold problems more than those who do not have asthma.