Finished the tokenizer. Tokens can be very easily added if needed.
Merge branch 'master' of github.com:travisolbrich/315-P1-DBMS