First working tokenizer implementation.

* Will most likely need to have its token range refined to simplify parsing.
* Isn't quite as clean as I would like. I may re-factor it some in the future.