Added resume to train_treetm.py
Fixed nsf1k, nsf10k, nsf25k dataset scripts.
Initial implementation of multiple model runs and ITMs.
Untrack tools/mallet*
Untrack all internal upload/download scripts.
Updated git ignore files.
Moved all dataset pre-processing to a separate repository.
Updated Corpus and STM importers to use SQLite3 database.
Updated existing training and import binary scripts to use SQLite3 database.
Converted metadata to SQLite3 database.
Updated setup script for all tools.
Finished converting all {MalletLDA, GensimLDA, STM, TreeTM} to use database. Checked all topic_model classes, reader classes, train_* scripts, read_* scripts, demo.py, and Makefile.
Copy all corpus/model files into app folder before processing each model.
Updated messages during training/importing.
Removed outdated import scripts.
Added the skeleton for LDAStats and CorpusStats DBs. Not yet tested!
Updated gitignore.
Validated all topic_model and reader classes.
Finished ComputeCorpusStats and ComputeLDAStats.
Use distinct term_index for corpus and LDA models.