Added comments to tokenize implementation