Fix bug with signs not being removed from tracking when broken