You'll only need to get rid of solid bath toys (with no holes at all) once they start to become damaged. For porous bath toys, if you've followed our cleaning advice and still suspect they're not up to par hygienically, it's always best to err on the side of caution and replace them with fresh ones you know are undoubtedly clean.