To remove old caulk from your bathroom, use a utility knife to cut along the edges and peel it off. Scrape any remaining caulk, then wipe the surface with mineral spirits or rubbing alcohol. Let it dry before applying the new caulk.