hitalex/PLSA — pull request #1 by erickpeirson (2013-09-29 23:50:12+00:00)
Title: added experimental multiprocessing method (psa_multi.py)

Learning how to use [multiprocessing](http://docs.python.org/2/library/multiprocessing.html), and thought I'd use this as an exercise. Have tested for up to 20 topics with 1.3k documents and ~16k terms. Peak memory usage was around 2GB. The code is not very pretty, but so far it looks like this halves the overall processing time, and produces reasonable results without choking.

Probably the ugliest thing here is that I made all of the matrices global, as I struggled to get memory usage under control. There is certainly a more elegant solution, so if this seems like a valuable direction then perhaps one more experienced with multiprocessing can re-implement.