SlowGuess/NeurIPS_2023_OCR huggingface dataset:
WLUP @-@ FM in Buffalo, New York, in 1952. In 1953, he joined the CBS radio network as a color commentator. His first assignment was to call the NFL championship game between the New York Giants and the Chicago Bears. The Giants won the game, 24 - 0. After the game, he was asked by a reporter if he had ever seen a game like that. " I have," he replied. " I've seen a lot of football. " He was also a color commentator for the CBS television series The NFL in 1954. During the 1950s, the NFL was the dominant league in America...
Figure 6: Example of generated text. The input text is in bleu, while the repetitions are in red. Both of the two models are fine-tuned on the Wikitext-103 for 3 epochs, as described in section B. We use greedy search for decoding.
D Classification of Repetition Words
We categorize repetitions into three groups, as outlined by Altmann and Kohler [1] and Tannen [28]: grammar, theme, and limited inventory. For each sampled instance, we initially determine whether the repetitive  $n$ -gram falls under the grammar category, meaning any word in the  $n$ -gram is a determiner, preposition, conjunction, etc. Next, if the repetitive  $n$ -gram does not belong to the grammar category, we assess whether any words are closely related to the text's subject matter, thereby placing it in the theme category. For instance, "H. gammarus" is considered part of the theme category when repetitively used in an article about Homarus gammarus. The third category encompasses repetitions stemming from a language's limited means of expressing a specific concept, known as limited inventory. Popular phrases such as "pair of" are examples of repetitive  $n$ -grams in this category.
In cases where multiple repetitive  $n$ -grams appear within a 256-word sentence, we only take one into account. If a repetitive  $n$ -gram satisfies the criteria for more than one category, particularly theme and limited inventory, we allocate it to the earliest applicable category.