Tokenizer refactoring/tests restructuring
Token.Type to abstract get only property
Token content now consumed from actual input
Merge pull request #4 from hiisi13/master

Tokenizer refactoring + Tests restructuring