The mouth is home to many types of bacteria, and they can increase in number if not routinely cleaned out. They grow on your teeth and gums, including in colonies visible as plaque.
One type of bacteria called Streptococcus Mutans is notorious for releasing acids that decay teeth, causing cavities. But multiple types of bacteria contribute to issues like bad breath and yellow teeth.