Better Tokenizer Final

Tokenizer now working perfectly. Added a free_token() function to
deallocate token memory.