The second purpose is to invite new members to join these important development efforts. I've already outlined most of the reasons for joining the TPC in another article, Why Join . Without further ado, then. This report will tell you about the TPC's new benchmark development efforts and its work in revising its current set of benchmarks. Here's what's wrong.
Benchmarks have a certain shelf-life.
Hardware and software technology advances continually undermine the relevancy of a benchmark workload. In addition, once a benchmark has been published, companies optimize their systems to run the benchmark faster. However, after a point, this process results in diminishing returns to the companies running the benchmarks and to the useful technology advances derived from the benchmarking exercise. Benchmarking is an experimental science. The goal of TPC benchmark workloads is to create a representative model of a complex, real-world workload.