You can wear contact lenses with swim goggles, but Dr. Layman recommends a tight-fitting pair. "Even if good disinfection systems are in place for pools, there is still bacteria in the water that can adhere to contact lens and cause eye infections," he explains. "That's why eye doctors advise their contact lens-wearing patients against swimming in lakes, rivers, streams, pools, and even showering with their lenses in without any additional eye protection."