An allergic reaction to condoms is usually caused by an allergy to latex, a common material used to make condoms. It's also possible to be allergic to the lubricant or spermicide that coats the condom.