Not necessarily but it can degrade the plastic over time and cause it to turn yellow. Yellowing caused by bleach use on your toilet seat is permanent. You can scrub until your arm falls off with the harshest cleanser, and the stain will still exist although your toilet seat may be damaged. The only way to get rid of yellow bleach stains is to repaint your toilet seat or replace it with a new one.