Adding an analyzer to assist with unit testing and adding a missing clearAttributes call to the token filter.
Removing support for emitting single tokens as I don't plan to use it and it drastically complicates the filter.
Cleaning up all the filter tests to use the assertAnalyzesTo helper
Extracting lazy debug logging methods into their own class.
Extracting some more char array util and testing them.
Simplified initial rewrite of token filter. More cases need testing and no current implementation for biggest phrase match.
More filter test cases.
Missed parameter to format string for logging.
Merge pull request #1 from jstrassburg/filterRewrite

Filter rewrite