Compilation: Expose tokenize for much profit

Close gh-242