You should always remove old sealant before applying new sealant. Use a sharp knife to remove the old sealant, and clean the area thoroughly, removing all the old sealant residue and dirt.