It is generally recommended to remove removable retainers during contact sports or physical activities to prevent damage or injury. For non-contact activities, you can wear your retainer, but always follow your orthodontist's advice. If you participate in contact sports, consider wearing a mouthguard to protect your teeth and retainer.