Allow runs that disable fast mode, and prune the scope of the benchmark job.