Don't assert score when it is infinity