If this happens, use a razor blade or putty knife and carefully remove the old caulk. Clean off any residue left behind with mineral spirits before applying new adhesive or high-temperature silicone.