Let's start with the obvious: The risks of wearing a dirty bra include bacteria possibly rubbing on your skin and causing an infection, according to Dr. Leah Ansell, a board-certified dermatologist in New York. “Yeast infections are common under the breast and are caused by a yeast called Candida,” she said.