aubry74/matomeru — pull request #19 by mpagli (2014-12-07 06:42:41+00:00)
Title: Feat11/add lemmatizer

Merging to master will bring few changes:
* The LDA processing is done now by mallet in ldaMalletProcessor.py. You can get mallet by running the install.sh command from the root directory.
* The final json has the following structure:

```
{
'phi': [
[ [p0, w0], [p1, w1], ... ], //topic0
[ [p0, w0], [p1, w1], ... ], //topic1
...
],
'theta': {
'title0': [ [topicIdx, p], [topicIdx, p], ... ],
'title1': [ [topicIdx, p], [topicIdx, p], ... ],
...
}
'phrases': [
[ [p0, phrase0], [p1, phrase1], ... ] //phrases for topic 0
[ [p0, phrase0], [p1, phrase1], ... ] //phrases for topic 1
...
]
}
```

* The second graph will not work since the data is not included in the json anymore.
* All the code is pylint compliant.