Outer ear infections, also known as swimmer's ear, are typically caused by bacterial infections that occur in the outer ear. However, they can also be caused by fungi or yeast. Certain actions like cleaning your ear with cotton buds or using hearing aids or earplugs can lead to damage in the ear canal, increasing the likelihood of developing an outer ear infection.