When in doubt, don't do it. Ask your jeweller. Most gemstones are not tough and are easily susceptible to scratches, chipping and breakage. Even diamonds the hardest substance known to man can be damaged by a sharp blow. Never wear your fine jewellery when doing household chores, repairs or gardening.
Chlorine bleach can react to the alloys in gold resulting in pitting or discolouration.
Do not wear them when engaged in some sports like swimming. Disinfectant chemicals in hot tubs and swimming pools can discolour many metals and harm many varieties of stones. Leave your fine jewellery at home when you plan a day at the beach or go fishing as salt water can affect many gemstones. Never leave your jewellery on the window sill in the sun, exposure to long periods of light can affect kunzite, some varities of quartz, chrysoprase and treated stones causing them to fade. Never expose your jewellery to sudden temperature changes, some gemstones are heat sensitive - opal, pearls, coral, amber, turquoise and emeralds.