It’s best to first remove the residue for a smooth finish. Simply painting over it can leave a rough patch.