Remove signs when arena gets removed.