Fix Non-Deterministic Pivot Test

This fixes a test that failed on build servers (small, slow, single or dual-core machines).