Extracted common equals(...) to BaseToken class
Added exception for invalid input
Added test for two tokens
Ignored multi-token test
Extracted char-to-token conversion
Replaced array with queue for processing
Resurrected multi-token test
Added loop into tokenizer