Word: tokenizer
Part of speech: Noun
Syllables: to
ke
ni
zer
Definition: A system that parses an input stream into its component tokens.
Morphemes:
Affix: token
Language: en
PoS: Noun
Meaning: A conceptual object that can be possessed by a computer, process, etc. in order to regulate a turn-taking system such as a token ring network.
Affix: -ize
Language: en
PoS: Suffix
Meaning: to make what is denoted by the noun/adjective
Affix: -er
Language: en
Meaning: agent noun