Updated tokens.pyx with advice from http://codereview.stackexchange.com/questions/38422/speeding-up-a-cython-program . The regex used was making the assumption that only N, V and J PoS tags exist, had to modify that.
Fixed a cosmetic issue in composed_thesauri_experiment. I had forgotten to set experiment name, so output files had wrong names, but were in the right directory. Results consolidation was not affected.
Modified Thesaurus and PrecomputedSimilaritiesVectorSource so that they can be constructed from an in-memory object and not just from a file. This dependency-injection thing will allow me to use a vector source backed by a thesaurus backed by a shelve-d dictionary to reduce memory usage
Integrate shelving functionality (introduced in e8c63f2) into complete pipeline. It's a really dirty and fragile piece of code but it seems to work