Tokenizer tests

Partial fix for #333 

I tried to make the enum anonymous like you said @rillian, but it seems like it blows up when I try to do it.

I've added tests for the cue text tokenizer functions. There are still more left to do.