Remove old signs for marks that are doubled up