There are many reasons that your eyes might reject your contacts. Your eyes can develop an intolerance to contact lens fluid, bacteria from unclean contacts, or even the material of the lenses themselves. Some common causes of contact lens intolerance include: Improper use, storage, or cleaning.