You should not allow your contacts to be exposed to water of any kind. You can wear goggles with contacts as long as you are sure the goggles fit well and no water will leak into them and expose your contacts to water. Ideally, avoid wearing contacts when you are swimming.