Complete the token parser and tests

This completes the implementation of a token parser which
makes it easy to represent an EYAML file in a simple
data structure in memory.