Put some white vinegar and baking soda to use. After applying the paste on the toilet seat, wait 10 to 30 minutes before using it. Rub the stains, then wipe the toilet seat with a cloth dipped in fresh, warm water. Repeat the technique if any stains are still present.