Moved test file to test directory.
Added utility functions to tokenize files and strings.