ad row-by-row test function, and refactor a bit
significant speedups for many of the statistics
new large test dataset
minor readme improvements