Word: tokenization
Part of speech: Noun
Syllables: to
ke
ni
za
tion
Definition: The act or process of tokenizing; the process of converting a sequence of characters (such as in a computer program or web page) into a sequence of tokens (strings with an assigned and thus identified meaning)
Morphemes:
Affix: token
Language: en
PoS: Noun
Meaning: A conceptual object that can be possessed by a computer, process, etc. in order to regulate a turn-taking system such as a token ring network.
Affix: -ize
Language: en
PoS: Suffix
Meaning: to make what is denoted by the noun/adjective
Affix: -ation
Language: en
PoS: Suffix
Meaning: An action or process