If something is being discharged from the pierced area at the moment, then it would be best not to remove them. The nipple rings act as the drainage, and removing them would tend to enclose the wounding and entrap the germs and harmful bacteria.