Updated unit tests so that they expect what the tokenizer now produces--- a corpus is a list of documents, which is a list of sentences, which is a list of tokens
started work on using more general n-gram composable features as well as unigrams. Mostly new code, but the format of  the features is now (AN, (big, cat)) instead of just a single string, which breaks a bunch of unit tests. still work in progress
Merge remote-tracking branch 'origin/bov-feature-extraction' into bov-feature-extraction

Conflicts:
	conf/exp0/exp0_base.conf
	thesisgenerator/plugins/bov.py