Load and use the tokenizer
Import the split_tokenizer
Remove tokenization from report generation
Add a default tokenizer

Splits on punctuation and whitespace, lower cases everything, and filter ''
Add a BaseTokenizer
Add tests for SplitTokenizer
Clean up a bunch of old or unused files

Various scripts for sorting and reformatting data,
Move report.py into a scripts directory.
Remove tox.ini
Import error should not block tockenizer
Hoist the docstring from the method into the class
Make mapping & filtering into a list comprehension
Update docstrings to mention the tokenizer
Add tox.ini back in
Fix #21

When the classifier isn't trained you shouldn't be able to use it.
Even in tests.
Fix docstring

I changed my mind in the middle and forgot to change the docstring
Use a custom exception, not built-in value error
Fix this python 2.6 assertion nonsense
Merge pull request #30 from iankronquist/tests-2.6-fixes

Fix this python 2.6 assertion nonsense
Merge pull request #29 from iankronquist/untrained-exception

Untrained exception
Merge pull request #24 from iankronquist/cleanup-10

Clean up a bunch of old or unused files
Be clear that we're using re.split