Add tokenize to parser.

This creates a tokenize() method that returns a list of token tuples.

I'm not sure if you'd like to do this differently but this version closes #1 and works for me.