Auto stop after a number of games to make benchmarking easier.