Stop the BenchmarkingCrashStore from subverting HBase

Takes the place of #2229