brkyvz/spark-perf — pull request #2 by dorx (2014-08-15 00:07:05+00:00)
Title: Chisquare

really hacky. just looking to get some numbers faster for the blog post.

for ChiSquaredFeatureTest:
Looking for numRows = 1M, 5M, 10M, 100M (optional)
numCols = 100, 200, 500, 1000 (optional)

for ChiSquaredGoFTest:
numRows = 10M, 50M, 100M (this is all local and numRows is the only parameter needed. numCol can be anything)

for ChiSquaredMatTest:
numRows = 10,000; 20,000; 30,000; 40,000; 50, 000 (i'm just going to make square matrices. these numbers are conservative because they need to fit on the driver).