Make this test a bit more robust to deal with the speed of CI.