Turn off the water valve for the toilet, which is usually near the floor. To get all the water out of the tank, flush the toilet again. Clean the inside of the tank's walls with a scrub brush to get rid of gunk and buildup. Use a sponge to remove any rust from the metal parts.