Moving stop words generator to be able to take objects. Also changing the tokenizer to try and also take a "suffixes" value that will aid in languages like Japanese, Inuktitut, etc…
Fixed error of extra spaces being introduced as parts of the tokenized words. Fixed sort function to work properly with text, as well as non-English text. Edited tests to pass the sort function properly.
The tokenizer will now replace punctuation and declared suffixes with spaces as appropriate. The stop-words generator will strip out those spaces, so as not to duplicate words.
Using a more descriptive variable object name.
Merge pull request #46 from iLanguage/commonjs_plugin

Commonjs plugin