Perf tests only work against non-failure cases