You will be given a definition of a task first, then some input of the task.
In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

This step entails counting occurrences of all words in the training corpus and sorting them in order of decreasing occurrence. As mentioned, the vocabulary is taken to be the INLINEFORM0 most frequently occurring words, that occur at least some number INLINEFORM1 times. It is implemented in Spark as a straight-forward map-reduce job.
Question: Do they perform any morphological tokenization?
Output:
No