Yes, do. If your baby plays with molded toys in the bath, mold can end up in the bathwater. Swallowing mold can be harmful in large doses, so prevent this by keeping your bath toys mold-free.