We don't need to remove the scores before removed the objective