Yeah, performance tests are sometimes inherently flakey ... but I think they're worth it, especially when flakes are localized & sent to the appropriate people. I'm hoping the averaging and lenient requirements makes it good enough it doesn't flake too often.

There is no speedup contract in general; speedup will happen when there's lots of little tasks, and not when there's time-consuming larger tasks.