Added stats generator.
Refactored spam processor to allow different tokenizers.
Refactored tests to use new stats.
Refactored load_data to support stats.