Now always remove the scoreboard
even when the fight was in prerunning