DarthTon/findpattern-bench — pull request #2 by afffsdd (2014-11-15 02:03:39+00:00)
Title: Remove unintentional bias for certain algorithms by randomizing test target locations

This is an issue. You can just hardcode results, which gets cheated times.

However, someone could "legitimately" make an algorithm that runs better in this benchmark even though it's inferior because of the hardcoded answers.

For example, running a scan backwards gets results very quickly, and beats all the other algorithms.