Remove non-deterministic test case

This would sometimes fail on Travis-CI giving spurious failures, and
doesn't test a vitally distinct path.