Yes, you should remove contact lenses before rinsing your eye to ensure proper flushing.