gwicke/testreduce — pull request #28 by choucalate (2014-03-09 09:29:34+00:00)
Title: Addressing Issue #17, front page statistics

https://github.com/gwicke/testreduce/issues/17

I did a couple things:
1) cql create-- pre revision summary stuff
2) fix the cassandra timeout
3) getstatistics

For the first, i was trying to address the inmemory revision summaries, but I wasn't sure how to go about it, or even if we needed it

For the second, there was a cassandra timeout when you changed the settings from mock to Cassandra Backend. The problem was that the new table uses a blob for test in test_by_score. And when you tried putting in something else that wasn't in that form, it wouldn't work.

For the last one, I didn't have the revision summaries yet, so i computed them based on score. I basically queried for all the test_by_scores-> and for each of the results, I basically computed either a -noerror, noskip, or no fail- based on the dbstatsquery from the original parsoid code.
I realize that if we have 160000 articles per commit, this will be... kind of slow :( but I'm just using a quick substitute for now.

I also used sebastian's https://gist.github.com/swong15/9061167
I inserted a few, and it worked fine, using the same commit hash