Original: N OISE -R OBUST D E -D UPLICATION AT S CALE
Revised: N OISE -R OBUST D E -D UPLICATION AT S CALE

Original: Anonymous authors

Original: Paper under double-blind review

Original: A BSTRACT
Revised: A BSTRACT

Original: Identifying near duplicates within large, noisy text corpora has a myriad of applications that range from de-duplicating training datasets, reducing privacy risk, and evaluating test set leakage, to identifying reproduced news articles and literature within large corpora.
Revised: Identifying near duplicates within large, noisy text corpora has a myriad of applications that range from de-duplicating training datasets, reducing privacy risk, and evaluating test set leakage, to identifying reproduced news articles and literature within large corpora.

Original: Across these diverse applications, the overwhelming majority of work relies on N -grams.
Revised: Across these diverse applications, the overwhelming majority of work relies on N -grams.

Original: Limited efforts have been made to evaluate how well N -gram methods perform, in part because it is unclear how one could create an unbiased evaluation dataset for a massive corpus.
Revised: Limited efforts have been made to evaluate how well N -gram methods perform, in part because it is unclear how one could create an unbiased evaluation dataset for a massive corpus.

Original: This study uses the unique timeliness of historical news wires to create a 27,210 document dataset, with 122,876 positive duplicate pairs, for studying noise-robust de-duplication.
Revised: This study uses the unique timeliness of historical news wires to create a 27,210 document dataset, with 122,876 positive duplicate pairs, for studying noise-robust de-duplication.

Original: The time-sensitivity of news makes comprehensive hand labelling feasible - despite the massive overall size of the corpus - as duplicates occur within a narrow date range.
Revised: The time-sensitivity of news makes comprehensive hand labelling feasible - despite the massive overall size of the corpus - as duplicates occur within a narrow date range.

Original: The study then develops and evaluates a range of de-duplication methods: hashing and N -gram overlap (which predominate in the literature), a contrastively trained bi-encoder, and a “re-rank” style approach combining a biand cross-encoder.
Revised: The study then develops and evaluates a range of de-duplication methods: hashing and N -gram overlap (which predominate in the literature), a contrastively trained bi-encoder, and a “re-rank” style approach combining a biand cross-encoder.

Original: The neural approaches significantly outperform hashing and
Revised: The neural approaches significantly outperform hashing and

Original: N -gram overlap.
Revised: N -gram overlap.

Original: We show that the bi-encoder scales well, de-duplicating amillion article corpus on a single GPU card in a matter of hours.
Revised: We show that the bi-encoder scales well, de-duplicating amillion article corpus on a single GPU card in a matter of hours.

Original: We also apply our pre-trained model to the RealNews and patent portions of C4 (Colossal Clean
Revised: We also apply our pre-trained model to the RealNews and patent portions of C4 (Colossal Clean

Original: Crawled Corpus), illustrating that a neural approach can identify many near duplicates missed by hashing, in the presence of various types of noise.
Revised: Crawled Corpus), illustrating that a neural approach can identify many near duplicates missed by hashing, in the presence of various types of noise.

Original: The public release of our NEWS-COPY de-duplication dataset, de-duplicated RealNews and patent corpuses, and the pre-trained models will facilitate further research and applications.
Revised: The public release of our NEWS-COPY de-duplication dataset, codebase, and the pre-trained models will facilitate further research and applications.

Original:  I NTRODUCTION
Revised:  I NTRODUCTION

Original: Robust identification of near-duplicate texts in large, noisy corpora is important for a variety of applications.
Revised: Robust identification of near-duplicate texts in large, noisy corpora is important for a variety of applications.

Original: Duplication in training data degrades model performance (Lee et al., 2021), can raise serious privacy risks (Kandpal et al., 2022), and can degrade performance on downstream tasks (Schofield et al., 2017; Liu et al., 2022; Allamanis, 2019).
Revised: Duplication in training data degrades model performance (Lee et al., 2021), can raise serious privacy risks (Kandpal et al., 2022), and can degrade performance on downstream tasks (Schofield et al., 2017; Liu et al., 2022; Allamanis, 2019).

Original: Additionally, the presence of test set leakage complicates evaluation of model performance, concerns that are elevated with large language models that have greater capacity to memorize training data or can consult an external database.
Revised: Additionally, the presence of test set leakage complicates evaluation of model performance, concerns that are elevated with large language models that have greater capacity to memorize training data or can consult an external database.

Original: Patterns of duplication are also themselves of interest, for studying the dissemination of reproduced content such as literature or news (Cordell, 2015; Smith et al., 2015; Vesanto et al., 2017) and for reducing noise in datasets used for statistical analyses.
Revised: Patterns of duplication are also themselves of interest, for studying the dissemination of reproduced content such as literature or news (Cordell, 2015; Smith et al., 2015; Vesanto et al., 2017) and for reducing noise in datasets used for statistical analyses.

Original: In contrast to the literature on semantic textual similarity, where deep neural architectures predominate - e.g. Reimers & Gurevych (2019) - text de-duplication overwhelmingly uses N -gram methods.
Revised: In contrast to the literature on semantic textual similarity, where deep neural architectures predominate - e.g. Reimers & Gurevych (2019) - text de-duplication overwhelmingly uses N -gram methods.

Original: There have been few efforts to formally evaluate the adequacy of N -gram based de-duplication or to explore potential performance gains from neural text de-duplication.
Revised: There have been few efforts to formally evaluate the adequacy of N -gram based de-duplication or to explore potential performance gains from neural text de-duplication.

Original: This study builds a large deduplication dataset and develops neural methods for robust textual de-duplication that significantly outperform N -gram based methods and scale efficiently.
Revised: This study builds a large deduplication dataset and develops neural methods for robust textual de-duplication that significantly outperform N -gram based methods and scale efficiently.

Original: A major hurdle to overcome in systematically studying text de-duplication is the lack of data for an unbiased evaluation of different methods.
Revised: A major hurdle to overcome in systematically studying text de-duplication is the lack of data for an unbiased evaluation of different methods.

Original: Typically, there is no way to exhaustively identify all duplicates of a given example in a large corpus, complicating comparisons of recall.
Revised: Typically, there is no way to exhaustively identify all du- plicates of a given example in a large corpus, complicating comparisons of recall.

Original: To circumvent this challenge, we examine duplication in historical news.
Revised: To circumvent this challenge, we examine duplication in historical news.

Original: Reproduction from news wires and syndicate services was widespread, forming over half the content of U.S. local newspapers.
Revised: Reproduction from news wires and syndicate services was widespread, forming over half the content of U.S. local newspapers.

Original: Media historian
Revised: Media historian

Original: Julia Guarneri (2017) writes: “by the 1910s and 1920s, most of the articles that Americans read in their local papers had either been bought or sold on the national news market...
Revised: Julia Guarneri (2017) writes: “by the 1910s and 1920s, most of the articles that Americans read in their local papers had either been bought or sold on the national news market...

Original: This constructed a broadly understood American ‘way of life’ that would become a touchstone of U.S. domestic politics and international relations throughout the twentieth century.”
Revised: This constructed a broadly understood American ‘way of life’ that would become a touchstone of U.S. domestic politics and international relations throughout the twentieth century.”

Original: Because news is timely, reproduction happens within a narrow time window, and hence annotators can exhaustively identify all duplicates despite the massive overall size of the corpus.
Revised: Because news is timely, reproduction happens within a narrow time window, and hence annotators can exhaustively identify all duplicates despite the massive overall size of the corpus.

Original: To build an unbiased evaluation sample, highly skilled human annotators manually reviewed every front page article from 973 newspapers on four randomly chosen days in 1930, 1955, and 1974 to create clusters of duplicated articles (including all singletons).
Revised: To build an unbiased evaluation sample, highly skilled human annotators manually reviewed every front page article from 973 newspapers on four randomly chosen days in 1930, 1955, and 1974 to create clusters of duplicated articles (including all singletons).

Original: Additional data, spanning the period from 1920 to 1977, were compiled for model training.
Revised: Additional data, spanning the period from 1920 to 1977, were compiled for model training.

Original: The resulting public NEWS-COPY dataset - which contains 27,210 articles, comprising 122,876 positive duplicate pairs - aims to encourage further study of robust de-duplication.
Revised: The resulting public NEWS-COPY dataset - which contains 27,210 articles, comprising 122,876 positive duplicate pairs - aims to encourage further study of robust de-duplication.

Original: In the absence of evaluation data, the literature has largely assumed that text de-duplication is sufficiently simple that neural methods are not required.
Revised: In the absence of evaluation data, the literature has largely assumed that text de-duplication is sufficiently simple that neural methods are not required.

Original: However, noise is an integral feature of large text datasets, resulting from OCR errors, abridgement, news aggregators, plagiarism, or machine translation, to name a few reasons.
Revised: However, noise is an integral feature of large text datasets, resulting from OCR errors, abridgement, news aggregators, plagiarism, or machine translation, to name a few reasons.

Original: This can lead near duplicate documents to have low N -gram similarity.
Revised: This can lead near duplicate documents to have low N -gram similarity.

Original: Amongst duplicated pairs of articles in the NEWS-COPY test set, the average Jaccard similarity using 3-grams (4-grams, 5-grams) between pairs of reproduced articles is 30% (26%, 23%).
Revised: Amongst duplicated pairs of articles in the NEWS-COPY test set, the average Jaccard similarity using 3-grams (4-grams, 5-grams) between pairs of reproduced articles is 30% (26%, 23%).

Original: 19% of duplicates have no 10-grams in common and 31% have no 15-grams in common, often as a result of minor text noise.
Revised: 19% of duplicates have no 10-grams in common and 31% have no 15-grams in common, often as a result of minor text noise.

Original: Neural methods are plausibly more robust.
Revised: Neural methods are plausibly more robust.

Original: Using the NEWS-COPY dataset, we examine different text de-duplication methods that vary along two key dimensions: whether or not the method is neural and computational cost.
Revised: Using the NEWS-COPY dataset, we examine different text de-duplication methods that vary along two key dimensions: whether or not the method is neural and computational cost.

Original: Drawing inspiration from work on semantic textual similarity and on retrieval, we develop two approaches for neural text de-duplication: a contrastively trained bi-encoder plus clustering method and a ‘reranking’ style method, which uses a computationally cheap transformer bi-encoder to measure the pairwise similarity between all articles and then passes each article’s nearest neighbors to a cross-encoder, at an additional computational cost.
Revised: Drawing inspiration from work on semantic textual similarity and on retrieval, we develop two approaches for neural text de-duplication: a contrastively trained bi-encoder plus clustering method and a ‘reranking’ style method, which uses a computationally cheap transformer bi-encoder to measure the pairwise similarity between all articles and then passes each article’s nearest neighbors to a cross-encoder, at an additional computational cost.

Original: We also examine N -gram overlap and locally sensitive hashing, the latter of which is highly scalable.
Revised: We also examine N -gram overlap and locally sensitive hashing, the latter of which is highly scalable.

Original: The neural methods significantly outperform the non-neural approaches.
Revised: The neural methods significantly outperform the non-neural approaches.

Original: The Adjusted Rand Index (ARI) for the re-rank model is 93.7 and for the bi-encoder model is 91.5, versus 73.7 for LSH and 75.0 for N -gram overlap.
Revised: The Adjusted Rand Index (ARI) for the re-rank model is 93.7 and for the bi-encoder model is 91.5, versus 73.7 for LSH and 75.0 for N -gram overlap.

Original: While the primary advantage of hashing - and a central motivation for its frequent usage - is its scalability, massive scale similarity search (Johnson et al., 2019) is sufficiently cheap on modern
Revised: While the primary advantage of hashing - and a central motivation for its frequent usage - is its scalability, massive scale similarity search (Johnson et al., 2019) is sufficiently cheap on modern

Original: GPUs to make neural de-duplication highly scalable.
Revised: GPUs to make neural de-duplication highly scalable.

Original: We use our contrastively-trained bi-encoder and a single NVIDIA 40GB A6000 GPU card to de-duplicate a 10 million document, 19 GB corpus in 11 hours and 45 minutes.
Revised: We use our contrastively-trained bi-encoder and a single NVIDIA 40GB A6000 GPU card to de-duplicate a 10 million document, 19 GB corpus in 11 hours and 45 minutes.

Original: While this cost is already marginal in the context of working with large text corpora, it could be reduced significantly further by using a lighter weight language model, as the majority of the time cost is embedding the 10M articles.
Revised: While this cost is already marginal in the context of working with large text corpora, it could be reduced significantly further by using a lighter weight language model, as the majority of the time cost is embedding the 10M articles.

Original: The publicly available neural de-duplication models can be applied off-the-shelf or provide a starting point for novel de-duplication problems.
Revised: The publicly available neural de-duplication models, available at https://github.com/ dell-research-harvard/NEWS-COPY , can be applied to novel de-duplication problems.

Original: To evaluate off-the-shelf performance in the presence of varying types of noise, we apply our bi-encoder model to two subsets of C4 (ColossalClean Crawled
Revised: To evaluate off-the-shelf performance, we apply our bi-encoder model to two subsets of C4 (Colossal

Original:  Corpus), a massive dataset created by applying a series of filters to a single snapshot of Common Crawl (Raffel et al., 2019; Dodge et al., 2021): RealNews - which consists of around 13 million digital news articles - and all 90,671 patents scraped from Google’s online patent database.
Revised: Clean Crawled Corpus), a massive dataset created by applying a series of filters to a single snapshot of Common Crawl (Raffel et al., 2019; Dodge et al., 2021): RealNews - which consists of aroundmillion digital news articles - and all 90,671 patents scraped from Google’s online patent database.

Original: We also examine test set leakage between SuperGlue (Sarlin et al., 2020) and RealNews.
Revised: We also examine test set leakage between SuperGlue (Sarlin et al., 2020) and RealNews.

Original: While there is not an unbiased ground truth measure for these datasets, an analysis of predicted duplicates shows that the bi-encoder detects a variety of noisy duplicates that hashing overlooks, which result from aggregators of digital news, machine translation, and other sources of noise.
Revised: While there is not an unbiased ground truth measure for these datasets, an analysis of predicted duplicates shows that the bi-encoder detects a variety of noisy duplicates that hashing overlooks, which result from aggregators of digital news, machine translation, and other sources of noise.

Original: The rest of this paper is organized as follows: Section 2 provides an overview of the relevant literature.
Revised: The rest of this paper is organized as follows: Section 2 provides an overview of the relevant literature.

Original: Section 3 describes the NEWS-COPY dataset, and Section 4 develops neural de-duplication methods and their non-neural comparisons.
Revised: Section 3 describes the NEWS-COPY dataset, and Section 4 develops neural de-duplication methods and their non-neural comparisons.

Original: Section 5 evaluates the performance of different deduplication methods, Section 6 explores scaling, and Section 7 applies de-duplication to a subset of
Revised: Section 5 evaluates the performance of different deduplication methods, Section 6 explores scaling, and Section 7 applies de-duplication to a subset of

Original: C4.
Revised: C4.

Original: Finally, Section 8 concludes.
Revised: Finally, Section 8 concludes.

Original:  L ITERATURE
Revised:  L ITERATURE

Original: De-Duplication:
Revised: De-Duplication:

Original: Textual de-duplication is a fundamental task for curating the large text corpora that support the deep learning revolution.
Revised: Textual de-duplication is a fundamental task for curating the large text corpora that support the deep learning revolution.

Original: Lee et al.
Revised: Lee et al.

Original: (2021) review the de-duplication literature, providing evidence that duplication in training datasets is widespread: e.g. Dodge et al.
Revised: (2021) review the de-duplication literature, providing evidence that duplication in training datasets is widespread: e.g. Dodge et al.

Original: (2021) find up to 14.4% of test examples of various standard benchmarks verbatim in C4 and Bandy & Vincent (2021) document that the Books Corpus (Zhu et al., 2015) - used in training BERT (Devlin et al., 2018), GPT (Brown et al., 2020), and other large language models - contains 4,255 unique books and 2,930 books that are exactly duplicated at least once.
Revised: (2021) find up to 14.4% of test examples of various standard benchmarks verbatim in C4 and Bandy & Vincent (2021) document that the Books Corpus (Zhu et al., 2015) - used in training BERT (Devlin et al., 2018), GPT (Brown et al., 2020), and other large language models - contains 4,255 unique books and 2,930 books that are exactly duplicated at least once.

Original: Lee et al.
Revised: Lee et al.

Original: (2021) document that models trained on deduplicated data regenerate approximatelytimes less training data, and Kandpal et al.
Revised: (2021) document that models trained on deduplicated data regenerate approximatelytimes less training data, and Kandpal et al.

Original: (2022) find a superlinear relationship between the number of times a sequence is present in training data and regeneration, with a sequence present 10 times being regenerated 1000 times more often than a sequence present once.
Revised: (2022) find a superlinear relationship between the number of times a sequence is present in training data and regeneration, with a sequence present 10 times being regenerated 1000 times more often than a sequence present once.

Original: Carlini et al.
Revised: Carlini et al.

Original: (2022) find that the likelihood of a model generating exact continuations from the training data scales with model size, training data duplicates, and prefix length.
Revised: (2022) find that the likelihood of a model generating exact continuations from the training data scales with model size, training data duplicates, and prefix length.

Original: This could raise plagiarism  (Lee et al., 2022) risks.
Revised: This could raise plagiarism risks (Lee et al., 2022).

Original: There is also a literature showing that duplicates adversely affect downstream tasks.
Revised: There is also a literature showing that duplicates adversely affect downstream tasks.

Original: Schofield et al.
Revised: Schofield et al.

Original: (2017) study the impact of text duplication on semantic models, documenting that substantial overrepresentation can overwhelm meaningful topical patterns.
Revised: (2017) study the impact of text duplication on semantic models, documenting that substantial overrepresentation can overwhelm meaningful topical patterns.

Original: Allamanis (2019) show that duplication in code datasets worsens performance on code understanding.
Revised: Allamanis (2019) show that duplication in code datasets worsens performance on code understanding.

Original: Liu et al.
Revised: Liu et al.

Original: (2022) show that de-duplication of an open electronic health record database significantly improves clinical natural language processing models.
Revised: (2022) show that de-duplication of an open electronic health record database significantly improves clinical natural language processing models.

Original: Moreover, when training LMs that can consult a massive external database - as in a retrieval enhanced transformer language setup (Borgeaud et al., 2022) - test set leakage becomes a particularly salient concern.
Revised: Moreover, when training LMs that can consult a massive external database - as in a retrieval enhanced transformer language setup (Borgeaud et al., 2022) - test set leakage becomes a particularly salient concern.

Original: Borgeaud et al.
Revised: Borgeaud et al.

Original: (2022) conclude: “Further work is yet needed to better understand the role of test set leakage in the performance of LMs.”
Revised: (2022) conclude: “Further work is yet needed to better understand the role of test set leakage in the performance of LMs.”

Original: Non-neural methods predominate in textual de-duplication (Leskovec et al., 2020).
Revised: Non-neural methods predominate in textual de-duplication (Leskovec et al., 2020).

Original: Borgeaud et al.
Revised: Borgeaud et al.

Original: (2022) compute 13-gram Jaccard similarity  any example with a 13-gram overlap with an evaluation example.
Revised: (2022) compute 13-gram Jaccard similarity between train and test documents using MinHashing and remove all training documents with 0.8 similarity or higher to validation/test documents. Radford et al. (2019) use 8-gram overlaps for post-hoc identification of duplication between GPT-2’s training data and evaluation datasets, and Brown et al. (2020) remove from the GPT-3 training data any example with a 13-gram overlap with an evaluation example.

Original: Other de-duplication contexts include large datasets of medical notes (Shenoy et al., 2017) and scholarly articles (which can include updates) (Gyawali et al., 2020), both of which have been examined with locally sensitive hashing.
Revised: Other de-duplication contexts include large datasets of medical notes (Shenoy et al., 2017) and scholarly articles (which can include updates) (Gyawali et al., 2020), both of which have been examined with locally sensitive hashing.

Original: Identifying reproduced texts within historical newspapers is itself an application that has generated considerable interest.
Revised: Identifying reproduced texts within historical newspapers is itself an application that has generated considerable interest.

Original: The Viral Texts Project (Cordell, 2015; Smith et al., 2015) uses N -gram comparisons to track the dissemination of reproduced literature in antebellum newspapers.
Revised: The Viral Texts Project (Cordell, 2015; Smith et al., 2015) uses N -gram comparisons to track the dissemination of reproduced literature in antebellum newspapers.

Original: Viral
Revised: Viral

Original: Texts utilizes the Chronicling America (Culpepper, 2007) OCR, which does not recognize individual articles, headlines, captions, etc.
Revised: Texts utilizes the Chronicling America (Culpepper, 2007) OCR, which does not recognize individual articles, headlines, captions, etc.

Original: This leads to scrambled up texts.
Revised: This leads to scrambled up texts.

Original: We first apply object detection methods to the document layouts (He et al., 2017; Shen et al., 2021) to extract structured texts of individual articles that allow us to capture performance gains from the language understanding of neural methods.
Revised: We first apply object detection methods to the document layouts (He et al., 2017; Shen et al., 2021) to extract structured texts of individual articles that allow us to capture performance gains from the language understanding of neural methods.

Original: Vesanto et al.
Revised: Vesanto et al.

Original: (2017) use NCBI BLAST, a software for comparing and aligning biological sequences, to quantify text reproduction at scale in Finish newspapers from 1771 to 1910.
Revised: (2017) use NCBI BLAST, a software for comparing and aligning biological sequences, to quantify text reproduction at scale in Finish newspapers from 1771 to 1910.

Original: They remove all characters besides the 23 most common letters from an uncased corpus of Finish newspapers, and then convert these to the alphabet of 23 amino acids recognized by BLAST.
Revised: They remove all characters besides the 23 most common letters from an uncased corpus of Finish newspapers, and then convert these to the alphabet of 23 amino acids recognized by BLAST.

Original: BLAST is used to make pairwise comparisons between all documents in the corpus, indicating which pairs have text overlap.
Revised: BLAST is used to make pairwise comparisons between all documents in the corpus, indicating which pairs have text overlap.

Original: To scale the problem, we use hashing - which avoids the need to convert texts into amino acid sequences - or a contrastively trained bi-encoder - which leverages the power of deep learning.
Revised: To scale the problem, we use hashing - which avoids the need to convert texts into amino acid sequences - or a contrastively trained bi-encoder - which leverages the power of deep learning.

Original: Semantic Textual Similarity: There are important parallels between semantic textual similarity (STS) and textual de-duplication.
Revised: Semantic Textual Similarity: There are important parallels between semantic textual similarity (STS) and textual de-duplication.

Original: Notably, our bi-encoder method draws inspiration from Sentence
Revised: Notably, our bi-encoder method draws inspiration from Sentence

Original: BERT (S-BERT) (Reimers & Gurevych, 2019), and we use an S-BERT pre-trained bi-encoder as our base language model.
Revised: BERT (S-BERT) (Reimers & Gurevych, 2019), and we use an S-BERT pre-trained bi-encoder as our base language model.

Original: S-BERT adds a pooling operation to BERT/RoBERTa embeddings - that takes the mean of all output vectors - to derive a fixed sized sentence embedding that can then be examined with clustering methods.
Revised: S-BERT adds a pooling operation to BERT/RoBERTa embeddings - that takes the mean of all output vectors - to derive a fixed sized sentence embedding that can then be examined with clustering methods.

Original: Retrieval : We draw inspiration for our reranking approach from the literature on open domain retrieval and question answering (Wang et al., 2018;
Revised: Retrieval : We draw inspiration for our reranking approach from the literature on open domain retrieval and question answering (Wang et al., 2018;

Original: Lin et al., 2018; Karpukhin et al., 2020; Thakur et al., 2021; Wu et al., 2019), which avoids the infeasible quadratic cost of applying a cross-encoder to a massive corpus by first ranking documents with a bi-encoder (or with sparse methods).
Revised: Lin et al., 2018; Karpukhin et al., 2020; Thakur et al., 2021; Wu et al., 2019), which avoids the infeasible quadratic cost of applying a cross-encoder to a massive corpus by first ranking documents with a bi-encoder (or with sparse methods).

Original: In our re-ranking model, instead of a passage encoder and a query encoder, there is a symmetric bi-encoder.
Revised: In our re-ranking model, instead of a passage encoder and a query encoder, there is a symmetric bi-encoder.

Original:  T HE NEWS-COPY D ATASET 3. R EPRODUCTION IN N EWS
Revised:  T HE NEWS-COPY D ATASET 3. R EPRODUCTION IN N EWS

Original: Reproduction is an important feature of news.
Revised: Reproduction is an important feature of news.

Original: News wire services distribute stories written by their own news bureaus and by member newspapers to member news outlets, whereas syndicates disseminate to their subscribers columns written by freelance journalists or purchased from newspapers.
Revised: News wire services distribute stories written by their own news bureaus and by member newspapers to member news outlets, whereas syndicates disseminate to their subscribers columns written by freelance journalists or purchased from newspapers.

Original: The nation’s largest newspapers also ran syndicate services to redistribute their own stories.
Revised: The nation’s largest newspapers also ran syndicate services to redistribute their own stories.

Original: The main news wire services in the United States historically were the Associated Press (AP), the United
Revised: The main news wire services in the United States historically were the Associated Press (AP), the United

Original: Press (UP), and the International News Service (INS), the latter two of which merged to form United
Revised: Press (UP), and the International News Service (INS), the latter two of which merged to form United

Original: Press International (UPI) in 1958.
Revised: Press International (UPI) in 1958.

Original: Editing could take place at multiple places along the news transmission chain.
Revised: Editing could take place at multiple places along the news transmission chain.

Original: Wire staff verified and edited stories after receiving them from members, and then stories could be edited again by local wire bureaus, of which there were around 100 for the Associated Press.
Revised: Wire staff verified and edited stories after receiving them from members, and then stories could be edited again by local wire bureaus, of which there were around 100 for the Associated Press.

Original: Finally, local newspapers could abridge content to fit space requirements.
Revised: Finally, local newspapers could abridge content to fit space requirements.

Original: This leads to a range of near-duplicates in the presence of abridgement and OCR noise.
Revised: This leads to a range of near duplicates in the presence of abridgement and OCR noise.

Original: Noisy duplicates in news are not limited to the historical context, with digital news aggregators today leading to a similar phenomenon Ingram (2021).
Revised: Noisy duplicates in news are not limited to the historical context, with digital news aggregators today leading to a similar phenomenon (Coddington, 2019).

Original: 3. D ESCRIPTION OF THE NEWS-COPY D ATASET
Revised: 3. D ESCRIPTION OF THE NEWS-COPY D ATASET

Original: Table 1 summarizes the key features of the NEWS-COPY dataset.
Revised: Table 1 summarizes the key features of the NEWS-COPY dataset.

Original: It consists of 27,210 articles, drawn from 973 newspapers between 1920 to 1977.
Revised: It consists of 27,210 articles, drawn from 973 newspapers between 1920 and 1977.

Original: 1 NEWS-COPY contains two types of data: data for training and four full day exhaustively labeled evaluation samples, constructed with two consecutive days of content in 1930 and single days in 1955 and 1974, selected at random.
Revised: 1 NEWS-COPY contains two types of data: data for training and four full day exhaustively labeled evaluation samples, constructed with two consecutive days of content in 1930 and single days in 1955 and 1974, selected at random.

Original: The 1955 sample is a validation set used to select hyperparemters for both the N -gram and neural methods.and 1974 are pooled to form the test set and used only to produce the results shown in this paper.
Revised: The 1955 sample is a validation set used to select hyperparemters for both the N -gram and neural methods.and 1974 are pooled to form the test set and used only to produce the results shown in this paper.

Original: In the full day samples, there are far more negative than positive pairs, as is generally the case in de-duplication problems, whereas the training data contain a more balanced sample.
Revised: In the full day samples, there are far more negative than positive pairs, as is generally the case in de-duplication problems, whereas the training data contain a more balanced sample.

Original: 3. P ROCEDURE F OR B UILDING THE D ATASET
Revised: 3. P ROCEDURE F OR B UILDING THE D ATASET

Original: To build NEWS-COPY , we first apply Layout Parser (Shen et al., 2021) with a custom-trained object detection model (He et al., 2017) to front page scans of off-copyright historical newspapers to identify individual article bounding boxes.
Revised: To build NEWS-COPY , we first apply Layout Parser (Shen et al., 2021) with a custom-trained object detection model (He et al., 2017) to front page scans of off-copyright historical newspapers to identify individual article bounding boxes.

Original: The contents of article bounding boxes are OCR’ed with
Revised: The contents of article bounding boxes are OCR’ed with

Original: Tesseract.
Revised: Tesseract.

Original: When component bounding boxes span multiple columns on the same page, the OCR’ed texts are associated into full articles using a rule-based association method that exploits the coordinates of headline and article bounding boxes.
Revised: When component bounding boxes span multiple columns on the same page, the OCR’ed texts are associated into full articles using a rule-based association method that exploits the coordinates of headline and article bounding boxes.

Original: This pipeline extracts the structured article texts.
Revised: This pipeline extracts the structured article texts.

Original: Headlines were chosen by local newspapers - not wires - and as a result are rarely reproduced and not included in the dataset.
Revised: Headlines were chosen by local newspapers - not wires - and as a result are rarely reproduced and not included in the dataset.

Original: Weather forecasts are removed by running a distil-RoBERTa classifier trained on 392 labeled articles (179 positive, 202 negative).
Revised: Weather forecasts are removed by running a distil-RoBERTa classifier trained on 392 labeled articles (179 positive, 202 negative).

Original: This removes 4.4% of the validation set and 3.3% of the test set.
Revised: This removes 4.4% of the validation set and 3.3% of the test set.

Original: We also hand-removed documents containing incorrectly merged article bounding boxes from different underlying source articles (as there was no single ground truth cluster to which these articles belonged), and news summaries, which summarize multiple news stories in a single article and hence also have no clear cluster with which they are associated.
Revised: We also hand-removed documents containing incorrectly merged article bounding boxes from different underlying source articles (as there was no single ground truth cluster to which these articles belonged), and news summaries, which summarize multiple news stories in a single article and hence also have no clear cluster with which they are associated.

Original: These represent 3.4% and 3.3% of the validation and test sets, respectively.
Revised: These represent 3.4% and 3.3% of the validation and test sets, respectively.

Original: Duplicates are defined as articles that came from the same original source article, regardless of the degree of abridgement or OCR noise.
Revised: Duplicates are defined as articles that came from the same original source article, regardless of the degree of abridgement or OCR noise.

Original: Articles from different source articles that contain the same quote are labeled as non-duplicated.
Revised: Articles from different source articles that contain the same quote are labeled as non-duplicated.

Original: Likewise, articles updated to reflect breaking news are labeled as different, as are different articles on the same overarching story.
Revised: Likewise, articles updated to reflect breaking news are labeled as different, as are different articles on the same overarching story.

Original:  To construct the full-day samples, we first ran 5 -gram overlap with a very conservative N -gram overlap threshold of 1% to create large candidate duplicate clusters.
Revised: [Table] To construct the full-day samples, we first ran 5 -gram overlap with a very conservative N -gram overlap threshold of 1% to create large candidate duplicate clusters.

Original: Highly trained student research assistants carefully reviewed these clusters, breaking false positive links.
Revised: Highly trained student research assistants carefully reviewed these clusters, breaking false positive links.

Original: A sub-sample was doubled-labeled to ensure our definition of a duplicated article was coherent, and that labeling was consistent across annotators.
Revised: A sub-sample was doubled-labeled to ensure our definition of a duplicated article was coherent, and that labeling was consistent across annotators.

Original: Interannotator agreement on a subset of 8512 pairs was 98.1% (90.
Revised: Interannotator agreement on a subset of 8512 pairs was 98.1% (90.

Original: [Table]

Original: Cohen’s Kappa).
Revised: Cohen’s Kappa).

Original: Next, annotators reviewed each of the resulting clusters to merge together clusters as needed.
Revised: Next, annotators reviewed each of the resulting clusters to merge together clusters as needed.

Original: Finally, annotators exhaustively reviewed every singleton article, associating them with article clusters as needed.
Revised: Finally, annotators exhaustively reviewed every singleton article, associating them with article clusters as needed.

Original: Articles were sorted by byline (recognized with a custom-trained named entity recognition model) to facilitate this process.
Revised: Articles were sorted by byline (recognized with a custom-trained named entity recognition model) to facilitate this process.

Original: For building the training data, the approach was similar, which provides hard negatives.
Revised: For building the training data, the approach was similar, which provides hard negatives.

Original: We did not review all singletons, as the aim was to produce labeled batches for constrastive training.
Revised: We did not review all singletons, as the aim was to produce labeled batches for constrastive training.

Original: About two thirds of the negative pairs in the training data are hard negatives, with the remaining third coming from randomly selected article pairs.
Revised: About two thirds of the negative pairs in the training data are hard negatives, with the remaining third coming from randomly selected article pairs.

Original:  M ODEL A RCHITECTURES 4. T HE B I -E NCODER M ODEL
Revised:  M ODEL A RCHITECTURES 4. T HE B I -E NCODER M ODEL

Original: We contrastively train a symmetric bi-encoder to learn similar representations for near duplicate articles and dissimilar representations for non-duplicated articles.
Revised: We contrastively train a symmetric bi-encoder to learn similar representations for near duplicate articles and dissimilar representations for non-duplicated articles.

Original: We use an S-BERT MPNET model (Reimers & Gurevych, 2019; Song et al., 2020) contrastively trained on over a billion sentence pairs - drawn from STS datasets - as the base language model.
Revised: We use an S-BERT MPNET model (Reimers & Gurevych, 2019; Song et al., 2020) contrastively trained on over a billion sentence pairs - drawn from STS datasets - as the base language model.

Original: The S-BERT architecture pools representations for up to the first 512 tokens in each article, using mean pooling, to construct a document level representation.
Revised: The S-BERT architecture pools representations for up to the first 512 tokens in each article, using mean pooling, to construct a document level representation.

Original: Like Reimers & Gurevych (2019), we found when experimenting with vanilla
Revised: Like Reimers & Gurevych (2019), we found when experimenting with vanilla

Original: RoBERTa embeddings - which also perform well on de-duplication - that mean pooling of each of the representations significantly outperforms using the [CLS] token to represent the document.
Revised: RoBERTa embeddings - which also perform well on de-duplication - that mean pooling of each of the representations significantly outperforms using the [CLS] token to represent the document.

Original: SBERT provides a speed-optimized implementation of this pooling strategy.
Revised: SBERT provides a speed-optimized implementation of this pooling strategy.

Original: We chose the MPNET
Revised: We chose the MPNET

Original: S-BERT because it performs best overall on STS benchmarks.
Revised: S-BERT because it performs best overall on STS benchmarks.

Original: We use S-BERT’s online contrastive loss (Hadsell et al., 2006) implementation, with a 0.2 margin and cosine similarity distance.
Revised: We use S-BERT’s online contrastive loss (Hadsell et al., 2006) implementation, with a 0.2 margin and cosine similarity distance.

Original: The learning rate is 2e-5 with 100% warm up and a batch size of 32.
Revised: The learning rate is 2e-5 with 100% warm up and a batch size of 32.

Original: We use an AdamW optimizer, and the model is trained for 16 epochs.
Revised: We use an AdamW optimizer, and the model is trained for 16 epochs.

Original: The bi-encoder dense document representations can be clustered to identify duplicates.
Revised: The bi-encoder dense document representations can be clustered to identify duplicates.

Original: We use
Revised: We use

Original: FAISS (Johnson et al., 2019) to compute all embeddings within a given distance range, a hyperparameter tuned on the full-day validation sample.
Revised: FAISS (Johnson et al., 2019) to compute all embeddings within a given distance range, a hyperparameter tuned on the full-day validation sample.

Original: This output is used to build a graph, where nodes are articles and edges connect articles within the threshold distance.
Revised: This output is used to build a graph, where nodes are articles and edges connect articles within the threshold distance.

Original: Connected components can be extracted to define clusters - which is equivalent to single linkage clustering - or Louvain community detection can be applied to the graph to control false positive edges that can merge otherwise disparate groups of articles.
Revised: Connected components can be extracted to define clusters - which is equivalent to single linkage clustering - or Louvain community detection can be applied to the graph to control false positive edges that can merge otherwise disparate groups of articles.

Original: 4. T HE R E -R ANKING M ODEL
Revised: 4. T HE R E -R ANKING M ODEL

Original: While a cross-encoder can offer the most flexible, expressive comparisons between texts, it requires N 2 embeddings to compare N texts, infeasible in large corpora.
Revised: While a cross-encoder can offer the most flexible, expressive comparisons between texts, it requires N 2 embeddings to compare N texts, infeasible in large corpora.

Original: To make the use of a crossencoder feasible, we draw inspiration from the retrieval literature (Wang et al., 2018; Lin et al., 2018;
Revised: To make the use of a crossencoder feasible, we draw inspiration from the retrieval literature (Wang et al., 2018; Lin et al., [Table]

Original:  Karpukhin et al., 2020; Thakur et al., 2021; Wu et al., 2019) by first ranking document similarity with a bi-encoder, and then passing the most similar documents to a cross-encoder.
Revised: ; Karpukhin et al., 2020; Thakur et al., 2021; Wu et al., 2019) by first ranking document similarity with a bi-encoder, and then passing the most similar documents to a cross-encoder.

Original: This approach, while not as cheap as simply clustering the bi-encoder embeddings, can still scale to a significant extent.
Revised: This approach, while not as cheap as simply clustering the bi-encoder embeddings, can still scale to a significant extent.

Original: We test whether it offers additional performance gains over using a bi-encoder alone.
Revised: We test whether it offers additional performance gains over using a bi-encoder alone.

Original: For the baseline re-ranking model, we choose a bi-encoder threshold of 0.92, optimized using[Table] the one-day validation sample (the supplementary material examines robustness to this threshold).
Revised: For the baseline re-ranking model, we choose a bi-encoder threshold of 0.92, optimized using the one-day validation sample (the supplementary material examines robustness to this threshold).

Original: We use RoBERTa-base (Liu et al., 2019) as the base language model, with a 2e-5 learning rate and an AdamW optimizer.
Revised: We use RoBERTa-base (Liu et al., 2019) as the base language model, with a 2e-5 learning rate and an AdamW optimizer.

Original: It is trained for 5 epochs with 20% warmup and a batch size of 32.
Revised: It is trained for 5 epochs with 20% warmup and a batch size of 32.

Original: 4. N- GRAM M ETHODS
Revised: 4. N- GRAM M ETHODS

Original: We explore two different N -gram methods: locality-sensitive hashing (LSH), as well as one which relies on full computation of N -gram overlaps.
Revised: We explore two different N -gram methods: locality-sensitive hashing (LSH), as well as one which relies on full computation of N -gram overlaps.

Original: For both methods, we first shingle each article into
Revised: For both methods, we first shingle each article into

Original: N -grams, where N ∈ { 3 , 4 , 5 , 10 , 15 } .
Revised: N -grams, where N ∈ { 3 , 4 , 5 , 10 , 15 } .

Original: Punctuation is removed from the text of the article during pre-processing to reduce noise.
Revised: Punctuation is removed from the text of the article during pre-processing to reduce noise.

Original: We define overlap as the Jaccard similarity between two documents, given by | A ∩ B | | A ∪ B | .
Revised: We define overlap as the Jaccard similarity between two documents, given by | A ∩ B | | A ∪ B | .

Original: We compute overlaps between each pair of articles, drawing an edge between two articles if the overlap is above some minimum overlap threshold.
Revised: We compute overlaps between each pair of articles, drawing an edge between two articles if the overlap is above some minimum overlap threshold.

Original: This hyperparameter is tuned on the validation sample.
Revised: This hyperparameter is tuned on the validation sample.

Original: We also choose N using the validation sample, with N = 3 providing the best Adjusted Rand Index.
Revised: We also choose N using the validation sample, with N = 3 providing the best Adjusted Rand Index.

Original: Once all edges have been drawn, Louvain community detection can be applied to remove false positives.
Revised: Once all edges have been drawn, Louvain community detection can be applied to remove false positives.

Original: For LSH, we use Datasketch’s MinHashLSH library, which is widely used in the literature.
Revised: For LSH, we use Datasketch’s MinHashLSH library, which is widely used in the literature.

Original: The two relevant hyperparameters are the number of hash functions and the minimum number of hash collisions needed to designate two documents as duplicates.
Revised: The two relevant hyperparameters are the number of hash functions and the minimum number of hash collisions needed to designate two documents as duplicates.

Original: For the former, we choose 10, which predominates in the literature, balancing computational efficiency and accuracy.
Revised: For the former, we choose 10, which predominates in the literature, balancing computational efficiency and accuracy.

Original: The latter is tuned on the validation sample.
Revised: The latter is tuned on the validation sample.

Original: All documents with at least the threshold number of hash collisions are defined as duplicates.
Revised: All documents with at least the threshold number of hash collisions are defined as duplicates.

Original: As with the other methods, community detection can be run once the graph has been constructed.
Revised: As with the other methods, community detection can be run once the graph has been constructed.

Original:  M ODEL E VALUATION 5. B ASELINE R ESULTS
Revised:  M ODEL E VALUATION 5. B ASELINE R ESULTS

Original: Table 2 compares the accuracy of 4 baseline models on the full-day test samples: non-neural methods ( N -gram overlap and hashing) and neural methods (bi-encoder and re-ranking).
Revised: Table 2 compares the accuracy of 4 baseline models on the full-day test samples: non-neural methods ( N -gram overlap and hashing) and neural methods (bi-encoder and re-ranking).

Original: For both of these, we examine a scalable method (hashing and bi-encoder) and a method that aims to achieve higher accuracy at some computational cost ( N -gram overlap and re-ranking).
Revised: For both of these, we examine a scalable method (hashing and bi-encoder) and a method that aims to achieve higher accuracy at some computational cost ( N -gram overlap and re-ranking).

Original: We do not evaluate the crossencoder alone, as the scale of most de-duplication applications makes it computationally infeasible.
Revised: We do not evaluate the crossencoder alone, as the scale of most de-duplication applications makes it computationally infeasible.

Original: The neural methods significantly outperform the N -gram based methods, increasing the adjusted
Revised: The neural methods significantly outperform the N -gram based methods, increasing the adjusted

Original: Rand index (ARI) (Hubert & Arabie, 1985) from 73.7 to 91.5 when comparing the most scalable methods (LSH and bi-encoder) and from 75.0 to 93.7 when comparing the more computationally costly methods ( N -gram overlap and re-ranking).
Revised: Rand index (ARI) (Hubert & Arabie, 1985) from 73.7 to 91.5 when comparing the most scalable methods (LSH and bi-encoder) and from 75.0 to 93.7 when comparing the more computationally costly methods ( N -gram overlap and re-ranking).

Original: In contrast, the more computationally intensive methods offer little advantage over their more scalable counterparts.
Revised: In contrast, the more computationally intensive methods offer little advantage over their more scalable counterparts.

Original: The ‘re-ranking’ strategy does offer modest gains over using a bi-encoder alone (ARI of 93.7 vs. 91.5), making it a compelling method for moderately size datasets where accuracy is paramount.
Revised: The ‘re-ranking’ strategy does offer modest gains over using a bi-encoder alone (ARI of 93.7 vs. 91.5), making it a compelling method for moderately size datasets where accuracy is paramount.

Original: These results underscore the potential returns of applying deep neural models to de-duplication of massive text datasets.
Revised: These results underscore the potential returns of applying deep neural models to de-duplication of massive text datasets.

Original: When neural false positives occur, it is typically in the context of articles that have some repeated content but do not meet the definition of duplicates used to create the
Revised: When neural false positives occur, it is typically in the context of articles that have some repeated content but do not meet the definition of duplicates used to create the

Original: NEWS-COPY dataset: i.e. the articles contain the same quote, are different articles about the same story, or one is an updated article that contains additional breaking news.
Revised: NEWS-COPY dataset: e.g. the articles contain the same quote, are different articles about the same story, or one is an updated article that contains additional breaking news.

Original: False negatives are most likely to occur when OCR errors are severe or abridgement is severe.
Revised: False negatives are most likely to occur when OCR errors are severe or abridgement is severe.

Original: If desired, further improve- ments in accuracy could plausibly be achieved by adding more of these challenging edge cases to the training data.
Revised: If desired, further improvements in accuracy could plausibly be achieved by adding more of these challenging edge cases to the training data.

Original: A quantitative analysis of the errors is given in the Appendix.
Revised: A quantitative analysis of the errors is given in the Appendix.

Original: With N -gram methods, errors are mechanical, occurring in articles where noise results in fewer Ngrams in common or where distinct articles by chance have significant overlap.
Revised: With N -gram methods, errors are mechanical, occurring in articles where noise results in fewer Ngrams in common or where distinct articles by chance have significant overlap.

Original: N -gram overlap and hashing control this tradeoff through a threshold, whereas neural methods are highly flexible and can be finely tuned to the downstream task through curation of appropriate training data.
Revised: N -gram overlap and hashing control this tradeoff through a threshold, whereas neural methods are highly flexible and can be finely tuned to the downstream task through curation of appropriate training data.

Original: The appendix examines a variety of ablations.
Revised: The Appendix examines a variety of ablations.

Original: The neural methods are robust to variations such as changing the contrastive loss function, changing the bi-encoder clustering threshold, and changing the clustering method (hierarchical agglomerative clustering slightly outperforms the baseline, at the cost of being less scalable).
Revised: The neural methods are robust to variations such as changing the contrastive loss function, changing the bi-encoder clustering threshold, and changing the clustering method (hierarchical agglomerative clustering slightly outperforms the baseline, at the cost of being less scalable).

Original: Changing the N used to construct N -grams also leaves the broad findings unchanged, as does using character level N -grams and forcing all text to its nearest dictionary match.As expected, off-the-shelf S-BERT (designed for semantic textual similarity) underperforms our textual de-duplication model (ARI 70 for the bi-encoder and 69.3 for re-ranking).
Revised: As expected, off-the-shelf S-BERT (designed for semantic textual similarity) underperforms our textual de-duplication model (ARI 70 for the bi-encoder and 69.3 for re-ranking). For the non-neural methods, changing the N used to construct N -grams also leaves the broad findings unchanged, as does using character level N -grams and forcing all text to its nearest dictionary match.

Original: When we split the test sample into articles from 1930 and 1974 - running analyses separately - the results are also qualitatively unchanged.
Revised: In all cases, when we split the test sample into articles from 1930 and 1974running analyses separately - the results are also qualitatively unchanged.

Original:  C OMPUTATIONAL E FFICIENCY
Revised:  C OMPUTATIONAL E FFICIENCY

Original: Hashing is often advocated because of its scalability, and neural methods for de-duplicating large text corpora likewise need to be highly scalable.
Revised: Hashing is often advocated because of its scalability, and neural methods for de-duplicating large text corpora likewise need to be highly scalable.

Original: We conduct experiments on a 19 GB, 10 million article corpus, created by applying the same object detection model used to curate NEWS-COPY to millions of front page newspaper page scans.
Revised: We conduct experiments on a 19 GB, 10 million article corpus, created by applying the same object detection model used to curate NEWS-COPY to millions of front page newspaper page scans.

Original: These experiments use a 32-Core 3.50 GHz AMD
Revised: These experiments use a 32-Core 3.50 GHz AMD

Original: RYZEN Threadripper Pro 3975WX and a single NVIDIA A6000 GPU, a very modest setup for working with large text corpora.
Revised: RYZEN Threadripper Pro 3975WX and a single NVIDIA A6000 GPU, a very modest setup for working with large text corpora.

Original: We scale the bi-encoder and LSH approaches to this corpus, reporting speeds in Table 3.
Revised: We scale the bi-encoder and LSH approaches to this corpus, reporting speeds in Table 3.

Original: The largest cost of scaling the bi-encoder, by a wide margin, is embedding the 10M articles, which takes 8:38:52 on a single GPU.
Revised: The largest cost of scaling the bi-encoder, by a wide margin, is embedding the 10M articles, which takes 8:38:52 on a single GPU.

Original: This could be sped up significantly by deploying a smaller language model.
Revised: This could be sped up significantly by deploying a smaller language model.

Original: However, since this cost is already fairly marginal in the context of working with massive text datasets, we do not explore this here.
Revised: However, since this cost is already fairly marginal in the context of working with massive text datasets, we do not explore this here.

Original: FAISS (Johnson et al., 2019), with IndexFlatIP , is used to calculate pairwise exact distances between the embeddings.
Revised: FAISS (Johnson et al., 2019), with IndexFlatIP , is used to calculate pairwise exact distances between the embeddings.

Original: These computations require just over 3 hours on a single GPU.
Revised: These computations require just over 3 hours on a single GPU.

Original: This produces a list of article pairs whose embeddings are within a threshold distance, using the optimal threshold selected in the NEWS-COPY full day validation sample.
Revised: This produces a list of article pairs whose embeddings are within a threshold distance, using the optimal threshold selected in the NEWS-COPY full day validation sample.

Original: We build a graph - where each of the 10M documents is a node and edges connect documents whose embeddings are within the threshold distance.
Revised: We build a graph - where each of the 10M documents is a node and edges connect documents whose embeddings are within the threshold distance.

Original: This takes 0:01:23 using CuDF and CuGraph .
Revised: This takes 0:01:23 using CuDF and CuGraph .

Original: False positives are controlled by running Louvain community detection on the graph; alternatively, one could define clusters simply by extracting the connected components.
Revised: False positives are controlled by running Louvain community detection on the graph; alternatively, one could define clusters simply by extracting the connected components.

Original: Total run-time on the single GPU card is 11:45:10.
Revised: Total run-time on the single GPU card is 11:45:10.

Original: While neural methods are not expected to be faster than hashing, they compare reasonably.
Revised: While neural methods are not expected to be faster than hashing, they compare reasonably.

Original: LSH requires 3:39:05 CPU hours for pre-processing, shingling, and hashing, and around 1 GPU minute to create the resulting graph and apply community detection.
Revised: LSH requires 3:39:05 CPU hours for pre-processing, shingling, and hashing, and around 1 GPU minute to create the resulting graph and apply community detection.

Original: Commonly used hashing libraries run on a CPU, and hence this is where we implement LSH, with Datasketch’s MinHashLSH.
Revised: Commonly used hashing libraries run on a CPU, and hence this is where we implement LSH, with Datasketch’s MinHashLSH.

Original: To effectively scale LSH, we slightly modify the previous architecture and break the hashes into bands comprised of rows of hashes.
Revised: To effectively scale LSH, we slightly modify the previous architecture and break the hashes into bands comprised of rows of hashes.

Original: Each of these bands is hashed again and two articles that share an identical band hash are considered duplicates.
Revised: Each of these bands is hashed again and two articles that share an identical band hash are considered duplicates.

Original: The choice of bands and rows determines an S -curve,  which gives the probability of being considered a duplicate given a certain Jaccard similarity.
Revised: The choice of bands and rows determines an S -curve, [Table] which gives the probability of being considered a duplicate given a certain Jaccard similarity.

Original: To generate our desired S -curve, we used 15 bands and 2 rows.
Revised: To generate our desired S -curve, we used 15 bands and 2 rows.

Original: The bi-encoder method detects 810,080 distinct reproduced articles.
Revised: The bi-encoder method detects 810,080 distinct reproduced articles.

Original: The average duplicated article was reproduced 6.41 times, strikingly similar to what we document in the single day NEWS-COPY labeled data.
Revised: The average duplicated article was reproduced 6.41 times, strikingly similar to what we document in the single day NEWS-COPY labeled data.

Original: This is expected, since most reproduced articles occur within the time window captured in the NEWS-COPY full day samples.
Revised: This is expected, since most reproduced articles occur within the time window captured in the NEWS-COPY full day samples.

Original: The number of true negative pairs is massively greater in the

Original: , we implement k nearest neighbor search, conservatively setting k to 900.

Original: Then distances are filtered to those below the optimal threshold found inour one day validation sample. In NEWS-COPY, articles are never reproduced more than 200 times, with theaverage reproduced article appearing 6.3 times, indicating that k = 900 is quite conservative. [Table] 10M article corpus, and it is encouraging that the average number of times articles are estimated to be reproduced remains quite constant, rather than being blown up by false positives.
Revised: The number of true negative pairs is massively greater in the 10M article corpus, and it is encouraging that the average number of times articles are estimated to be reproduced remains quite constant, rather than being blown up by false positives.

Original: In contrast,
Revised: In contrast,

Original: LSH detects only 486,460 distinct reproduced articles, estimating that each on average appears 11.
Revised: LSH detects only 486,460 distinct reproduced articles, estimating that each on average appears 11.

Original: times.
Revised: times.

Original: This is significantly greater than in the labeled NEWS-COPY data, and likely indicates that false positives are significantly increasing the size of detected duplicated article groups.
Revised: This is significantly greater than in the labeled NEWS-COPY data, and likely indicates that false positives are significantly increasing the size of detected duplicated article groups

Original:  N OISY D UPLICATES IN C OMMON C RAWL
Revised:  N OISY D UPLICATES IN C OMMON C RAWL

Original: To evaluate off-the-shelf performance in the presence of varying types of noise, we apply our pretrained bi-encoder model and hashing to two subsets of C4 (Colossal Clean Crawled Corpus), a massive dataset created by applying a series of filters to a single snapshot of Common Crawl (Raffel et al., 2019; Dodge et al., 2021): RealNews - which consists of around 13 million digital news articles - and all 90,671 patents from Google’s online patent database, which is the largest single domain in C4.
Revised: To evaluate off-the-shelf performance in the presence of varying types of noise, we apply our pretrained bi-encoder model and hashing to two subsets of C4 (Colossal Clean Crawled Corpus), a massive dataset created by applying a series of filters to a single snapshot of Common Crawl (Raffel et al., 2019; Dodge et al., 2021): RealNews - which consists of around 13 million digital news articles - and all 90,671 patents from Google’s online patent database, which is the largest single domain in C4.

Original: While the ground truth for  these datasets is unknown, an analysis of predicted duplicates suggests that the neural method detects a variety of noisy duplicates that a standard application of hashing overlooks.
Revised: While the ground truth for duplication in these datasets is unknown, an analysis of predicted duplicates suggests that the neural method detects a variety of noisy duplicates that a standard application of hashing overlooks.

Revised: In the RealNews data, news aggregators, which tend to make small edits to digital news stories before releasing them on their own sites (Coddington, 2019), can generate noisy duplicates.

Revised: In the patents data, one source of duplicates is noisy translation, as patents are routinely filed in multiple countries and non-English language patents were machine-translated into English.

Revised: OCR noise is also present for older patents.

Revised: A de-duplicated Google patent dataset could be of direct relevance to researchers working with patent data, which are the backbone of a large literature studying the drivers of innovation.

Original: [Table]
Revised: [Table]

Original: The bi-encoder is applied off-the-shelf, with the same hyperparameters as used in the NEWS-COPY analyses.
Revised: The bi-encoder is applied off-the-shelf, with the same hyperparameters as used in the NEWS-COPY analyses.

Original: We also use the same definition of a noisy duplicate.
Revised: We also use the same definition of a noisy duplicate.

Original: For hashing, we found that applying the same parameters resulted in a large number of false positives, detecting 40 times more duplicate pairs than the bi-encoder.
Revised: For hashing, we found that applying the same parameters resulted in a large number of false positives, detecting 40 times more duplicate pairs than the bi-encoder.

Original: This further underscores the brittleness of rule-based methods.
Revised: This further underscores the brittleness of rule-based methods.

Original: Instead, we follow the approach of Borgeaud et al.
Revised: Instead, we follow the approach of Borgeaud et al.

Original: (2022) for controlling test set leakage in the Retrieval
Revised: (2022) for controlling test set leakage in the Retrieval

Original: Enhanced Transformer model: hashing with 10-gram collisions and a Jaccard similarity threshold of 0.8.
Revised: Enhanced Transformer model: hashing with 10-gram collisions and a Jaccard similarity threshold of 0.8.

Original: Following GPT-3 (Radford et al., 2019), we ignore clusters above a certain size (using a threshold of 1000 for RealNews and 300 for patents).
Revised: Following GPT-3 (Radford et al., 2019), we ignore clusters above a certain size (using a threshold of 1000 for RealNews and 300 for patents).

Original: The bi-encoder detects 27 of these for
Revised: The bi-encoder detects 27 of these for

Original: RealNews and 7 for patents, whereas they do not appear with hashing.
Revised: RealNews and 7 for patents, whereas they do not appear with hashing.

Original: These tend to be templates, for things such as medical reports, crime reports, and obituaries.
Revised: These tend to be templates for articles such as medical reports, crime reports, and obituaries.

Original: Randomly-selected examples are shown in the Appendix.
Revised: Randomly-selected examples are shown in the Appendix.

Original: These might also be undesirable for training and downstream tasks, but conservative
Revised: These might also be undesirable for training and downstream tasks, but we ignore them to be conservative.

Original: Table 4 reports statistics from de-duplicating the training set of RealNews, as well as all patents (which doesn’t have a train-test split).
Revised: Table 4 reports statistics from de-duplicating the training set of RealNews, as well as all patents (which does not have a train-test split).

Original: It reports several measures of duplicates: the number of duplicate clusters, the total number of articles in a duplicate cluster, average cluster size, the number of unique clusters detected with one method but not the other, and the number of duplicates marked for removal with one method but not the other.
Revised: It reports several measures of duplicates: the number of clusters of duplicated texts, the total number of articles in a duplicate cluster, average cluster size, the number of unique clusters detected with one method but not the other, and the number of texts marked for removal with one method but not the other.

Original: The neural method identifies around an order of magnitude more duplicates than hashing.
Revised: The neural method identifies around an order of magnitude more duplicates than hashing.

Original: Average cluster size is roughly similar.
Revised: Average cluster size is roughly similar.

Original: The appendix provides randomly selected examples of predicted duplicate clusters.
Revised: The Appendix provides randomly selected examples of predicted duplicate clusters.

Original: The duplicates predicted by the neural method but not hashing are true positives with reasonably high probability.
Revised: The duplicates predicted by the neural method but not hashing are true positives with reasonably high probability.

Original: In a random sample of 50 clusters that are detected by the neural method but not by hashing, 20% are false positives for RealNews and 4% are false positives for the patent data.
Revised: In a random sample of 50 clusters that are detected by the neural method but not by hashing, 20% are false positives for RealNews and 4% are false positives for the patent data.

Original: As in NEWS-COPY, many of the false positives consist of updated news stories.
Revised: As in NEWS-COPY, many of the false positives consist of updated news stories.

Original: When examining duplicates predicted by LSH but not the bi-encoder, 44% are false positives in RealNews and 16% are false positives for the patents.
Revised: When examining duplicates predicted by LSH but not the bi-encoder, 44% are false positives in RealNews and 16% are false positives for the patents.

Original: In the RealNews data, news aggregators, which tend to make small edits to digital news stories before releasing them on their own sites (Ingram, 2021), can generate noisy duplicates.

Original: In the patents data, one source of duplicates is noisy translation, as patents are routinely filed in multiple countries and non-English language patents were machine-translated into English.

Original: OCR noise is also present for older patents.

Original: A de-duplicated Google patent dataset could be of direct relevance to researchers working with patent data, which are the backbone of a large literature studying the drivers of innovation.

Original: Table 5 examines test set leakage on RealNews, using the RealNews development set and the SuperGlue benchmark (Sarlin et al., 2020) as a case study.
Revised: Table 5 examines test set leakage on RealNews, using the RealNews development set and the SuperGlue benchmark (Sarlin et al., 2020) as a case study.

Original: Exact duplicates are removed in preprocessing.
Revised: Exact duplicates are removed in preprocessing.

Original: 4 For datasets in SuperGlue that do not primarily consist of news, test set leakage is low.
Revised: 4 For datasets in SuperGlue that do not primarily consist of news, test set leakage is low.

Original: These serve as a placebo, showing that neither method detects duplicates when there is no reason to expect many.
Revised: These serve as a placebo, showing that neither method detects duplicates when there is no reason to expect many.

Original: In contrast, when examples are drawn from news, the neural method predicts considerable leakage.
Revised: In contrast, when examples are drawn from news, the neural method predicts considerable leakage.

Original: An analysis of a random sample of (up to) 50 neural predicted duplicates suggests that most are true positives, with the false positive rate ranging from 0% on 17 duplicates predicted from BoolQ (drawn from Wikipedia) to 16% on a random sample of 50 duplicates predicted from the RealNews development set.
Revised: An analysis of a random sample of (up to) 50 neural predicted duplicates suggests that most are true positives, with the false positive rate ranging from 0% on 17 duplicates predicted from BoolQ (drawn from Wikipedia) to 16% on a random sample of 50 duplicates predicted from the RealNews development set.

Original: These false positives are often updated articles.
Revised: These false positives are often updated articles.

Original: In contrast, hashing finds almost no duplicates.
Revised: In contrast, hashing finds almost no duplicates.

Original: The appendix provides examples of predicted duplicate clusters.
Revised: The Appendix provides examples of predicted duplicate clusters.

Original: [Table]
Revised: [Table]

Original:  C ONCLUSIONS
Revised:  C ONCLUSIONS

Original: De-duplication is important to a range of NLP training and evaluation tasks, as well as for creating datasets that are of direct interest to researchers.
Revised: De-duplication is important to a range of NLP training and evaluation tasks, as well as for creating datasets that are of direct interest to researchers.

Original: This study provides evidence that neural methods offer significant performance gains - even on corpora that differ significantly from examples seen during training - and are highly scalable.
Revised: This study provides evidence that neural methods offer significant performance gains - even on corpora that differ significantly from examples seen during training - and are highly scalable.

Original: These results suggest that neural text de-duplication is straightforward and well worth further examination in a range of contexts where it might improve model performance, control test set leakage
Revised: These results suggest that neural text de-duplication is straightforward and well worth further examination in a range of contexts where it might improve model performance, control test set leakage, or yield cleaner datasets for downstream analyses.

Original: [Table]
Revised: A CKNOWLEDGMENTS

Original: or yield cleaner datasets for downstream analyses.
Revised: We thank Abhishek Arora, Vania Cheung, and William Cox for excellent research assistance.

Original: A A PPENDIX A. A BLATIONS
Revised: A A PPENDIX A. A BLATIONS

Original: Tables A1 - A4 explore several sets of ablations to the neural and non-neural methods.
Revised: Tables A1 - A4 explore several sets of ablations to the neural and non-neural methods.

Original: Community detection can detect false positive links between otherwise disparate clusters.
Revised: Community detection can detect false positive links between otherwise disparate clusters.

Original: Removing it makes little to no difference for the neural models (Table A1) but leads to a somewhat larger decline in performance for N -gram overlap and hashing (Table A3).
Revised: Removing it makes little to no difference for the neural models (Table A1) but leads to a somewhat larger decline in performance for N -gram overlap and hashing (Table A3).

Original: This underscores the greater robustness of the neural approaches, whereas the non-neural methods are more prone to false positives that link otherwise disparate groups of articles.
Revised: This underscores the greater robustness of the neural approaches, whereas the non-neural methods are more prone to false positives that link otherwise disparate groups of articles.

Original: Next, Table A1 considers whether hierarchical agglomerative clustering (HAC), which does not scale well, improves the accuracy of the bi-encoder approach.
Revised: Next, Table A1 considers whether hierarchical agglomerative clustering (HAC), which does not scale well, improves the accuracy of the bi-encoder approach.

Original: There are modest gains, with ARI increasing from 91.5 to 92.5, which highlights the potential returns of using HAC for moderatelysized de-duplication problems
Revised: There are modest gains, with ARI increasing from 91.5 to 92.5, which highlights the potential returns of using HAC for moderatelysized de-duplication problems.

Original: [Table]
Revised: [Table]

Original: Table A1 also considers off-the-shelf S-BERT (Reimers & Gurevych, 2019), a model trained to detect semantic textual similarity (STS).
Revised: Table A1 also considers off-the-shelf S-BERT (Reimers & Gurevych, 2019), a model trained to detect semantic textual similarity (STS).

Original: STS and de-duplication are distinct problems - despite STS being framed sometimes as the removal of (semantic) duplicates.
Revised: STS and de-duplication are distinct problems - despite STS being framed sometimes as the removal of (semantic) duplicates.

Original: As expected, the models designed for STS perform inadequately on textual de-duplication (ARI 70 for the bi-encoder and 69.3 for re-ranking), though these results are not that much worse than LSH despite not being trained for this task.
Revised: As expected, the models designed for STS perform inadequately on textual de-duplication (ARI 70 for the bi-encoder and 69.3 for re-ranking), though these results are not that much worse than LSH despite not being trained for this task.

Original: Figure A
Revised: performance with different Cosine Similarity Thresholds

Original: For the neural methods, we also explore different loss functions for contrastively training the biencoder - supervised contrastive (SupCon) loss (Khosla et al., 2020) 5 and multiple negatives ranking loss (MNRL) (Henderson et al., 2017).
Revised: For the neural methods, we also explore different loss functions for contrastively training the biencoder - supervised contrastive (SupCon) loss (Khosla et al., 2020) 5 and multiple negatives ranking loss (MNRL) (Henderson et al., 2017).

Original: The online contrastive loss outperforms both of these alternative losses in both neural approaches.
Revised: 6 Online contrastive loss outperforms both of these alternative losses in both neural approaches.

Original: Moreover, Figure A1 examines robustness to varying the cosine similarity threshold, showing that results are quite robust.
Revised: Moreover, Figure A1 examines robustness to varying the cosine similarity threshold, showing that results are quite robust.

Original: An alternative to word level N -grams is character level N -grams.
Revised: An alternative to word level N -grams is character level N -grams.

Original: These have the downside of being substantially more computationally costly.
Revised: These have the downside of being substantially more computationally costly.

Original: Table A2 examines N equal to 10, 15, 20, and 25.
Revised: Table A2 examines N equal to 10, 15, 20, and 25.

Original: Performance is modestly better for hashing and modestly worse for N -gram overlap.
Revised: Performance is modestly better for hashing and modestly worse for N -gram overlap.

Original: Neural methods beat character N -grams by a wide margin.
Revised: Neural methods beat character N -grams by a wide margin.

Original: [Table]
Revised: [Table]

Original: To explore the potential of more aggressive text cleaning to improve the N -gram based methods, we allow SymSpell to correct words up to an edit distance of 5, which results in the overwhelming share of spell-corrected text appearing in the dictionary.
Revised: To explore the potential of more aggressive text cleaning to improve the N -gram based methods [Table] we allow SymSpell to correct words up to an edit distance of 5, which results in the overwhelming share of spell-corrected text appearing in the dictionary.

Original: This modestly improves performance for both hashing (ARI 75.9) and N -gram overlap (ARI 81.1), without changing the overall conclusions (Table A3).
Revised: This modestly improves performance for both hashing (ARI 75.9) and N -gram overlap (ARI 81.1), without changing the overall conclusions (Table A3).

Original: For the N -gram based methods, we chose the optimal N = 3 on the one-day validation sample.
Revised: For the N -gram based methods [Table] we chose the optimal N = 3 on the one-day validation sample.

Original: Table A3 also varies N - with the overlap threshold/number of collisions for each N again chosen to maximize ARI in the one-day validation sample.
Revised: Table A3 also varies N - with the overlap threshold/number of collisions for each N again chosen to maximize ARI in the one-day validation sample.

Original: For both LSH, and N -gram overlap
Revised: For both LSH, and N -gram overlap

Original: N = 3 remains optimal in the test set.
Revised: N = 3 remains optimal in the test set.

Original: [Table]
Revised: [Table]

Original: Numbers report the Adjusted Rand Index.
Revised: Adjusted Rand Index.

Original: No community detection removes community detection.
Revised: No community detection removes community detection

Original: In Dict.

Original: applies spell checking parameters thatensure that the overwhelming share of words appear in a dictionary.
Revised: applies spell checking parameters that that the overwhelming share of words appear in a dictionary columns

Original: The other columns vary the N used to compute N -grams and include community detection.
Revised: N grams

Original: The baseline results pool the labeled full-day samples from 1930 and 1974.
Revised: The baseline results pool the labeled full-day samples from 1930 and 1974.

Original: When these are analyzed separately, the average ARI between the two samples is similar to that in the pooled sample, as there are few false positive links between decades.
Revised: When these are analyzed separately, the average ARI between the two samples is similar to that in the pooled sample, as there are few false positive links between decades.

Original: Performance is better in the 1970s across methods due to a cleaner OCR.
Revised: Performance is better in the 1970s across methods due to a cleaner OCR.

Original: [Table]
Revised: [Table]

Original: A. E RROR A NALYSIS
Revised: A. E RROR A NALYSIS

Original: To understand the type of errors that were most commonly made by our bi-encoder method, we sampled 50 false positive pairs and 50 false negative pairs from the NEWS-COPY analysis and categorised them by types of error.
Revised: To understand the type of errors that were most commonly made by our bi-encoder method, we sampled 50 false positive pairs and 50 false negative pairs from the NEWS-COPY analysis and categorised them by types of error.

Original: A.2. F ALSE P OSITIVES
Revised: A.2. F ALSE P OSITIVES

Original: Amongst the 50 randomly selected false positive examined, 48 contained articles that were about the same story, but were either from different wire services, or different coverage from the same wire service.
Revised: Amongst the 50 randomly selected false positive examined, 48 contained articles that were about the same story, but were either from different wire services, or different coverage from the same wire service.

Original: 2 were incorrectly labelled.
Revised: 2 were incorrectly labelled.

Original: The same errors were made repeatedly.
Revised: The same errors were made repeatedly.

Original: For example, seven of the examples contained duplicates of the two articles about a fire that are in table A5.
Revised: For example, seven of the examples contained duplicates of the two articles about a fire that are in table A5.

Original: WASHINGTON (AP) — The House has passed legis- lation raising the minimum wage from $1.60 an hour to $2 this year for most workers covered and to $2.30 for all by 1978.
Revised: WASHINGTON (AP) — The House has passed legis- lation raising the minimum wage from $1.60 an hour to $2 this year for most workers covered and to $2.30 for all by 1978.

Original: The bill, approved Wednes-day 375 to 37, also would in-crease by 7 million to 56.5 mil-lion the number of workers cov-ered by the minimum wage laws.
Revised: The bill, approved Wednes-day 375 to 37, also would in-crease by 7 million to 56.5 mil-lion the number of workers cov-ered by the minimum wage laws.

Original: The bill is a modified version of one President Nixon vetoed last year.
Revised: The bill is a modified version of one President Nixon vetoed last year.

Original: WASHINGTON (AP) — The House passed a bill Wednesday raising the minimum wage to $2 an hour this year for most workers covered and to $2.30 for all by 1978.
Revised: WASHINGTON (AP) — The House passed a bill Wednesday raising the minimum wage to $2 an hour this year for most workers covered and to $2.30 for all by 1978.

Original: It also extends coverage to 7 million more per- sons, including household em-ployes.
Revised: It also extends coverage to 7 million more per- sons, including household em-ployes.

Original: The bill, ap- proved 375 to 37, is a modified version of the one President Nixon vetoed last year.
Revised: The bill, ap- proved 375 to 37, is a modified version of the one President Nixon vetoed last year.

Original: Greeley, Colo., Jan. 28.
Revised: Greeley, Colo., Jan. 28.

Original: — Seven persons perished to- day in a fire that destroyed the home of Paul Martinez at
Revised: — Seven persons perished to- day in a fire that destroyed the home of Paul Martinez at

Original: Frederick, a small mining camp southwest of Gree-ley.
Revised: Frederick, a small mining camp southwest of Gree-ley.

Original: : me The dead were Mrs. Martinez, her five children ranging in age from an infant a few months old to 12 years, and a man known as Newon who attempted to res- cue them.
Revised: : me The dead were Mrs. Martinez, her five children ranging in age from an infant a few months old to 12 years, and a man known as Newon who attempted to res- cue them.

Original: Martinez was at work at the time.
Revised: Martinez was at work at the time.

Original: ee: Newlon, operating pumps at mine near by, ran to the build-ing and shouted in an effort: to awaken the sleep- ing family.
Revised: ee: Newlon, operating pumps at mine near by, ran to the build-ing and shouted in an effort: to awaken the sleep- ing family.

Original: FREDERICK, Colo., Jan. 28.
Revised: FREDERICK, Colo., Jan. 28.

Original: (P) — Seven persons were burned to death in a fire to- day in a two-room shack ‘near the Slopline mine.
Revised: (P) — Seven persons were burned to death in a fire to- day in a two-room shack ‘near the Slopline mine.

Original: Mrs. — Paul Mar- tinez, her five chil-dren, ranging in age from 13 ‘months to 15 years, and a ’miner named Newlon lost their lives.
Revised: Mrs. — Paul Mar- tinez, her five chil-dren, ranging in age from 13 ‘months to 15 years, and a ’miner named Newlon lost their lives.

Original: Newton 
Revised: Newton discovered the

Original: [Table]
Revised: [Table]

Revised: window and was

Revised: [Table]

Revised: to

Revised: [Table]

Revised: [Table]

Revised: fire

Revised: [Table]

Revised: to

Revised: [Table]

Revised: start

Revised: [Table]

Revised: an overheated

Revised: [Table]

Revised: her

Revised: [Table]

Revised: of

Revised: [Table]

Revised: of

Revised: [Table]

Original: F ALSE N EGATIVES
Revised: A

Revised: . F ALSE N EGATIVES

Original: Among 50 randomly selected false negatives examined, in 16 cases, at least one of the articles was very poorly OCR’ed (see for example, the first pair in table A6).
Revised: Among 50 randomly selected false negatives examined, in 16 cases at least one of the articles was very poorly OCR’ed (see for example, the first pair in table A6).

Original: In 15 cases, one of the articles was missing the first few paragraphs.
Revised: In 15 cases, one of the articles was missing the first few paragraphs.

Original: This case can occur if an article is continued on an interior page.
Revised: This case can occur if an article is continued on an interior page.

Original: In four cases, one of the articles was heavily truncated (see for example, the first pair in table A6), and in another five cases, a significant proportion of the middle of an article was missing.
Revised: In four cases, one of the articles was heavily truncated (see for example, the first pair in table A6), and in another five cases, a significant proportion of the middle of an article was missing.

Original: Finally, in four cases, the pair was mislabeled, and in six cases there was no obvious cause of the error.
Revised: Finally, in four cases, the pair was mislabeled, and in six cases there was no obvious cause of the error.

Original: — Kansas City, Harses, Jen, 26 — on the stow ¡n 2m ope¿ : ed the place todey ‘where fire persous were crashed and ‘burmed to death in a flamicg cz /Finne.
Revised: — Kansas City, Harses, Jen, 26 — on the stow ¡n 2m ope¿ : ed the place todey ‘where fire persous were crashed and ‘burmed to death in a flamicg cz /Finne.

Original: — Fret Brke Laudemsn, apparently lexruggling with = failing moter back pene an efart to land als Trarelair [Sivanasence- carrier gt 2 time wb ‘he could see the stingicg heecor and red mersers Qf Farriex airporr, hus goal, jess 2 mle azar.
Revised: — Fret Brke Laudemsn, apparently lexruggling with = failing moter back pene an efart to land als Trarelair [Sivanasence- carrier gt 2 time wb ‘he could see the stingicg heecor and red mersers Qf Farriex airporr, hus goal, jess 2 mle azar.

Original: The airplane which few from.
Revised: The airplane which few from.

Original: Wichita, ans late Mandar, Was behind schedule and dark
Revised: Wichita, ans late Mandar, Was behind schedule and dark

Original: Ness had closed ia when the irea- ; ble developed.
Revised: Ness had closed ia when the irea- ; ble developed.

Original: Laudeman, losing ( altitude accor to witResse:.
Revised: Laudeman, losing ( altitude accor to witResse:.

Original: atung away from 4 buiding then - Went into = vertical bank te exash ; from sbout 150 feet... – i The cew of a se- icy enging near’
Revised: atung away from 4 buiding then - Went into = vertical bank te exash ; from sbout 150 feet... – i The cew of a se- icy enging near’

Original: [the scese sad the crit was envelop red 19 Fames hefore 10 Tel “The rotor jwes broLen in halt both sections ciz- ging inte the harm sround.
Revised: [the scese sad the crit was envelop red 19 Fames hefore 10 Tel “The rotor jwes broLen in halt both sections ciz- ging inte the harm sround.

Original: The steel framesork, and utdereas age ‘wae [oeisced and charred.
Revised: The steel framesork, and utdereas age ‘wae [oeisced and charred.

Original: Everyibing else, uichiding the bodies of che pilo¿ and
Revised: Everyibing else, uichiding the bodies of che pilo¿ and

Original: Ins 2 four — Passengers, wes Ducted.
Revised: Ins 2 four — Passengers, wes Ducted.

Original: Kansas City, Kan. Jan. 28, WP — A black mark on (he snow ‘in an open field here, marked the place tadey where five persons were crushed and buried to death in a Haming alrplone.
Revised: Kansas City, Kan. Jan. 28, WP — A black mark on (he snow ‘in an open field here, marked the place tadey where five persons were crushed and buried to death in a Haming alrplone.

Original: Pilot Dyke Laudeman, apparentiy struggling with a failings motor had made an effort to land his Travel- nl six passenger carrier at a time when he could ser the aswhighng rhencgn and red markers of Fairfax, Alrport, nls goal, junta mile oway.
Revised: Pilot Dyke Laudeman, apparentiy struggling with a failings motor had made an effort to land his Travel- nl six passenger carrier at a time when he could ser the aswhighng rhencgn and red markers of Fairfax, Alrport, nls goal, junta mile oway.

Original: The airplane which few fran Wichita, Kaun, lute Monday, was behlint seliedule and darkness had lelesed in when the traume de el.
Revised: The airplane which few fran Wichita, Kaun, lute Monday, was behlint seliedule and darkness had lelesed in when the traume de el.

Original: — oped.
Revised: — oped.

Original: Lauder, losing altitude — Rcrordlyg to witnesses, swung away from a buildingthen went into P vertical bank lo crash trom about 150 feat, ‘The crew of a switch engine near (he scene sold
Revised: Lauder, losing altitude — Rcrordlyg to witnesses, swung away from a buildingthen went into P vertical bank lo crash trom about 150 feat, ‘The crew of a switch engine near (he scene sold

Original: Lhe craft wis env 1- oped In flinnes before 16 fell.
Revised: Lhe craft wis env 1- oped In flinnes before 16 fell.

Original: ‘the motor was broken 1 hall, hoth sections digging into the hard bround, The steel framework, ane wnilercar- riage owas dwisted — and charred, Everythity else, Inelnd my the bodles af the pilot nnd his Tout Wssetgers, was burned, The dead were: Pilot Dyke Laudeman, Ka:
Revised: ‘the motor was broken 1 hall, hoth sections digging into the hard bround, The steel framework, ane wnilercar- riage owas dwisted — and charred, Everythity else, Inelnd my the bodles af the pilot nnd his Tout Wssetgers, was burned, The dead were: Pilot Dyke Laudeman, Ka:

Original: City, Kan, Putsengers Miss Murgiret Dice, St. Joseya Mo. .R.
Revised: City, Kan, Putsengers Miss Murgiret Dice, St. Joseya Mo. .R.

Original: Meltinnon, Chicago, recent energy items were responsib] for about a fifth of last month’ Increase in prices The Consumer Price Inde climbed last month to 1415 ¢ its 1987 average,
Revised: Meltinnon, Chicago, recent energy items were responsib] for about a fifth of last month’ Increase in prices The Consumer Price Inde climbed last month to 1415 ¢ its 1987 average,

Original: mean-
Revised: mean-

Original: ing tha it cost ‘ consumers $141 90 ¢ buy the same amount of reta goods and services that $10 bought in 1987 While consumer prices cor tinued their sharp rise.
Revised: ing tha it cost ‘ consumers $141 90 ¢ buy the same amount of reta goods and services that $10 bought in 1987 While consumer prices cor tinued their sharp rise.

Original: rea spendable earnings of worker dropped another six- tenths one per centin February ani were down 45 per cent from , year ago This was the larges decline over a vear since th government began keeping that statistic in
Revised: rea spendable earnings of worker dropped another six- tenths one per centin February ani were down 45 per cent from , year ago This was the larges decline over a vear since th government began keeping that statistic in

Original: WASHINGTON (AP) — The pace ..of inflation quick- ened in February with food and fuel prices pushing the cost of liv- ing up 13 per ce, the seearid biggest monthly jump since 4951, dhe government suid Lo- day. ,
Revised: WASHINGTON (AP) — The pace ..of inflation quick- ened in February with food and fuel prices pushing the cost of liv- ing up 13 per ce, the seearid biggest monthly jump since 4951, dhe government suid Lo- day. ,

Original: The Labor Department said last month’s rise sent con- sumer prices 10 per cent bigher than a year ago :and miarked th first time since 1948’ that ‘the United States experienced - double figure inllstion:
Revised: The Labor Department said last month’s rise sent con- sumer prices 10 per cent bigher than a year ago :and miarked th first time since 1948’ that ‘the United States experienced - double figure inllstion:

Original: -Was.
Revised: -Was.

Original: the highest 12-month iuerease in the cost of living since: consumer prices rose by 10.2 per cent in the 12 months ending
Revised: the highest 12-month iuerease in the cost of living since: consumer prices rose by 10.2 per cent in the 12 months ending

Original: January 1948.
Revised: January 1948.

Original: Nearly half the February increase - was attributed a higher food prices with the price of beef raising 7.5 per eent, the sharpest jump since a 9.6 per cent increase in June 1947, Gasoline and other energy ilems were responsible for about a fifth of last month’s increase m prices.
Revised: Nearly half the February increase - was attributed a higher food prices with the price of beef raising 7.5 per eent, the sharpest jump since a 9.6 per cent increase in June 1947, Gasoline and other energy ilems were responsible for about a fifth of last month’s increase m prices.

Original: The Consumer , Price Index climbed last month to 141.5 of its 1967 average, meaning that it cost consumers $141.50 to buy the same amount of retail gaorls and services thal $100 bonght in 1967. 
Revised: The Consumer , Price Index climbed last month to 141.5 of its 1967 average, meaning that it cost consumers $141.50 to buy the same amount of retail gaorls and services thal $100 bonght in 1967. WASHINGTON,

Original: [Table]
Revised: [Table]

Revised: on

Original: [Table]
Revised: [Table]

Revised: announced

Revised: [Table]

Revised: [Table]

Original: on
Revised: on

Original: [Table]
Revised: [Table]

Original: Great
Revised: Great

Original: [Table]
Revised: [Table]

Original: had an-
Revised: had announced

Original: [Table]
Revised: [Table]

Original: of the
Revised: of the

Original: [Table]
Revised: [Table]

Original: two
Revised: of

Original: [Table]
Revised: [Table]

Revised: two

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: A. E XAMPLES OF D UPLICATES IN C 
Revised: A. E XAMPLES OF D UPLICATES IN C

Original: In this section, we provide randomly selected examples of predicted duplicates, organized by dataset, along with a brief discussion of the patterns that emerge.
Revised: In this section, we provide randomly selected examples of predicted duplicates, organized by dataset, along with a brief discussion of the patterns that emerge.

Original: The full set of duplicates detected by each method (including for RealNews and GooglePatents) will be made publicly available with the

Original: NEWS-COPY dataset.

Original: [Table]
Revised: [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: ”; Kenan

Original: [Table]
Revised: [Table]

Original: ”Saturday

Original: Night
Revised: [Table] [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: Winkler, ”Barry
Revised: ”Saturday

Original: [Table]
Revised: [Table]

Original: ”n12. ON the morning of Oct. 7, George Kimmerle of Mend- ham, N.J., decided he was fed up.
Revised: ON the morning of Oct. 7, George Kimmerle of Mend- ham, N.J., decided he was fed up.

Original: He and his wife,
Revised: He and his wife,

Original: Lynn, had spent the last two years trying to obtain zon-
Revised: Lynn, had spent the last two years trying to obtain zon-

Original: ing approval to renovate the small cottage in the borough of Stonington they had bought in 1996 as a week- end retreat.
Revised: ing approval to renovate the small cottage in the borough of Stonington they had bought in 1996 as a week- end retreat.

Original: The cottage is next door to the 160-year-old
Revised: The cottage is next door to the 160-year-old

Original: Stonington Lighthouse, which once guided ships from Watch Hill, R.I., in the east to Fisher’s Island, N.Y., in the west.
Revised: Stonington Lighthouse, which once guided ships from Watch Hill, R.I., in the east to Fisher’s Island, N.Y., in the west.

Original: On Oct. 7, Mr. Kimmerle learned that the Stonington Historical Society, which operates the lighthouse as a museum, was soliciting donations to fight his plan once again.
Revised: On Oct. 7, Mr. Kimmerle learned that the Stonington Historical Society, which operates the lighthouse as a museum, was soliciting donations to fight his plan once again.

Original: The cottage is small, and the couple had at first wanted to build a 196-square-foot addition with large windows facing the lighthouse.
Revised: The cottage is small, and the couple had at first wanted to build a 196-square-foot addition with large windows facing the lighthouse.

Original: On the morning of Oct. 7, George Kimmerle of Mend- ham decided he was fed up.
Revised: On the morning of Oct. 7, George Kimmerle of Mend- ham decided he was fed up.

Original: He and his wife, Lynn, had spent the last two years trying to obtain zoning ap- proval to renovate a cottage they had bought inas a weekend retreat that sat next to the 160-year-old Stonington Lighthouse, with its dramatic ocean views of Watch Hill, R.I., and Fisher’s Island, N.Y.
Revised: He and his wife, Lynn, had spent the last two years trying to obtain zoning ap- proval to renovate a cottage they had bought inas a weekend retreat that sat next to the 160-year-old Stonington Lighthouse, with its dramatic ocean views of Watch Hill, R.I., and Fisher’s Island, N.Y.

Original: On that day Mr. Kimmerle, an architect, had learned that the
Revised: On that day Mr. Kimmerle, an architect, had learned that the

Original: Stonington Historical Society, which operates the light- house as a museum, was soliciting donations to fight his plan.
Revised: Stonington Historical Society, which operates the light- house as a museum, was soliciting donations to fight his plan.

Original: The cottage was small, and at first the couple wanted to build a 196-square-foot addition.
Revised: The cottage was small, and at first the couple wanted to build a 196-square-foot addition.

Original: After that plan was rejected by the Planning and Zoning Commis- sion, they submitted one for 167 square feet.
Revised: After that plan was rejected by the Planning and Zoning Commis- sion, they submitted one for 167 square feet.

Original: Question papers of two subjects of the SSC (Class X) exam conducted by the Maharashtra State Board were found leaked at Bhiwandi in Thane district of Maha- rashtra on Wednesday, police said.
Revised: Question papers of two subjects of the SSC (Class X) exam conducted by the Maharashtra State Board were found leaked at Bhiwandi in Thane district of Maha- rashtra on Wednesday, police said.

Original: A case was registered at Narpoli police station against an unidentified person in this connection.
Revised: A case was registered at Narpoli police station against an unidentified person in this connection.

Original: “As per the complaint filed by a state board official, examination of history and po- litical science subjects was scheduled to take place on
Revised: “As per the complaint filed by a state board official, examination of history and po- litical science subjects was scheduled to take place on

Original: Wednesday,” senior inspector M B Shinde of Narpoli police station said on Thursday.
Revised: Wednesday,” senior inspector M B Shinde of Narpoli police station said on Thursday.

Original: “For the exam that was to start at 11 am, students were expected to be in the exam hall by 10.15 am.
Revised: “For the exam that was to start at 11 am, students were expected to be in the exam hall by 10.15 am.

Original: However, outside an exam centre at Kalher in Bhiwandi, the board official found some girl students checking their mobile phones inside an autorickshaw,” he added.
Revised: However, outside an exam centre at Kalher in Bhiwandi, the board official found some girl students checking their mobile phones inside an autorickshaw,” he added.

Original: Question papers of two subjects of the SSC (Class X) exam conducted by the Maharashtra State Board were found leaked at Bhiwandi in Thane district of Maha- rashtra on Wednesday, police said.
Revised: Question papers of two subjects of the SSC (Class X) exam conducted by the Maharashtra State Board were found leaked at Bhiwandi in Thane district of Maha- rashtra on Wednesday, police said.

Original: A case was registered at Narpoli police station against an unidentified person in this connection.
Revised: A case was registered at Narpoli police station against an unidentified person in this connection.

Original: “As per the complaint filed by a state board official, examination of history and po- litical science subjects was scheduled to take place on
Revised: “As per the complaint filed by a state board official, examination of history and po- litical science subjects was scheduled to take place on

Original: Wednesday,” senior inspector M B Shinde of Narpoli police station said on Thursday. ”
Revised: Wednesday,” senior inspector M B Shinde of Narpoli police station said on Thursday. ”

Original: For the exam that was to start at 11 am, students were expected to be in the exam hall by 10.15 am.
Revised: For the exam that was to start at 11 am, students were expected to be in the exam hall by 10.15 am.

Original: However, outside an exam centre at Kalher in Bhiwandi, the board official found some girl students checking their mobile phones inside an autorickshaw,” he added.
Revised: However, outside an exam centre at Kalher in Bhiwandi, the board official found some girl students checking their mobile phones inside an autorickshaw,” he added.

Original: Star Wars characters will descend on Horsham town centre in an bid to raise charity funds.
Revised: Star Wars characters will descend on Horsham town centre in an bid to raise charity funds.

Original: Gobsmack Comics will host its third annual Star
Revised: Gobsmack Comics will host its third annual Star

Original: Wars day, known as Force February, in Swan Walk on Saturday February 2.
Revised: Wars day, known as Force February, in Swan Walk on Saturday February 2.

Original: Drew Dewsall, the store’s owner, is inviting residents to join a host of characters from a galaxy far far away in raising funds for the Springboard Project by dressing up as their favourite figures from the iconic film series.
Revised: Drew Dewsall, the store’s owner, is inviting residents to join a host of characters from a galaxy far far away in raising funds for the Springboard Project by dressing up as their favourite figures from the iconic film series.

Original: He said: “The aim is just to give the people of Horsham something different to do.
Revised: He said: “The aim is just to give the people of Horsham something different to do.

Original: A host of Star Wars characters will descend on Horsham town centre next month.
Revised: A host of Star Wars characters will descend on Horsham town centre next month.

Original: Drew Dewsall, the stores owner, is inviting residents to join a host of characters from a galaxy far far away in raising funds for the Springboard Project by dress-
Revised: Drew Dewsall, the stores owner, is inviting residents to join a host of characters from a galaxy far far away in raising funds for the Springboard Project by dress-

Original: ing up as their favourite figures from the iconic film series.
Revised: ing up as their favourite figures from the iconic film series.

Original: Visitors can expect a range of characters at the event.
Revised: Visitors can expect a range of characters at the event.

Original: Star Wars characters are heading to Horsham town centre to help raise charity funds this weekend.
Revised: Star Wars characters are heading to Horsham town centre to help raise charity funds this weekend.

Original: Gobs- mack Comics is holding its third annual Star Wars day, known as Force February, in Swan Walk on Saturday (February 2) at 10am.
Revised: Gobs- mack Comics is holding its third annual Star Wars day, known as Force February, in Swan Walk on Saturday (February 2) at 10am.

Original: Owner Drew Dewsall is inviting visitors to dress up as their favourite figures and give money to the Springboard
Revised: Owner Drew Dewsall is inviting visitors to dress up as their favourite figures and give money to the Springboard

Original: Project.
Revised: Project.

Original: Drew, a lifelong Star Wars fan, said that visitors to the shop can expect to see Chewbacca, as well as stormtroopers, snowtroopers, jedi and Princess Leia, all in movie qual- ity costumes.
Revised: Drew, a lifelong Star Wars fan, said that visitors to the shop can expect to see Chewbacca, as well as stormtroopers, snowtroopers, jedi and Princess Leia, all in movie qual- ity costumes.

Original: US President Donald Trump di- rected his ire on Tuesday at the nation’s major social media compa- nies, claiming they’re biased against
Revised: US President Donald Trump di- rected his ire on Tuesday at the nation’s major social media compa- nies, claiming they’re biased against

Original: Republicans and attacking them with the same gusto he uses for much of the rest of the media world.
Revised: Republicans and attacking them with the same gusto he uses for much of the rest of the media world.

Original: Trump’s focus on social media began with a morning tweet and con- tinued into a press conference with
Revised: Trump’s focus on social media began with a morning tweet and con- tinued into a press conference with

Original: Brazilian President Jair Bolsonaro, where he reveled in the rightwing leader’s use of Trump’s trademark phrase ”fake news”.
Revised: Brazilian President Jair Bolsonaro, where he reveled in the rightwing leader’s use of Trump’s trademark phrase ”fake news”.

Original: Trump’s complaints come after he spent much of the weekend on Twitter, where he attacked a litany of targets including the late Sen. John McCain of Arizona, General Motors and “Saturday Night Live”.
Revised: Trump’s complaints come after he spent much of the weekend on Twitter, where he attacked a litany of targets including the late Sen. John McCain of Arizona, General Motors and “Saturday Night Live”.

Original: President Donald Trump speaks dur-
Revised: President Donald Trump speaks dur-

Original: ing a news conference with visiting
Revised: ing a news conference with visiting

Original: Brazilian President Jair Bolsonaro, on the Rose Garden of the White
Revised: Brazilian President Jair Bolsonaro, on the Rose Garden of the White

Original: House, March 19, 2019, in Wash- ington.
Revised: House, March 19, 2019, in Wash- ington.

Original: WASHINGTON — President Donald Trump directed his ire Tuesday at the nation’s major social media companies, claiming they’re biased against Republicans and attacking them with the same gusto he uses for much of the rest of the media world.
Revised: WASHINGTON — President Donald Trump directed his ire Tuesday at the nation’s major social media companies, claiming they’re biased against Republicans and attacking them with the same gusto he uses for much of the rest of the media world.

Original: Trump’s focus on social media began with a morning tweet and continued into a press
Revised: Trump’s focus on social media began with a morning tweet and continued into a press

Original: confer- ence with Brazilian President Jair
Revised: confer- ence with Brazilian President Jair

Original: Bolsonaro, where he reveled in the rightwing leader’s use of Trump’s trademark phrase “fake news.”
Revised: Bolsonaro, where he reveled in the rightwing leader’s use of Trump’s trademark phrase “fake news.”

Original: WASHINGTON - President Don- ald Trump directed his ire Tuesday at the nation’s major social media companies, claiming they’re biased against Republicans and attacking them with the same gusto he uses for much of the rest of the media world.
Revised: WASHINGTON - President Don- ald Trump directed his ire Tuesday at the nation’s major social media companies, claiming they’re biased against Republicans and attacking them with the same gusto he uses for much of the rest of the media world.

Original: Trump’s comments came in response to a question about whether he could go along with legislation to make social media companies li- able for their content on their platforms.
Revised: Trump’s comments came in response to a question about whether he could go along with legislation to make social media companies li- able for their content on their platforms.

Original: Trump and some support- ers have long accused Silicon Valley companies of being biased against them.
Revised: Trump and some support- ers have long accused Silicon Valley companies of being biased against them.

Original: Conservatives are complaining that those steps are dispropor- tionally aimed at their side of the political spectrum.
Revised: Conservatives are complaining that those steps are dispropor- tionally aimed at their side of the political spectrum.

Original: Click here for the most recent update on the potential winter weather.
Revised: Click here for the most recent update on the potential winter weather.

Original: The Piedmont Triad could see snow, ice and freezing rain over the weekend and it could con- tinue into Monday.
Revised: The Piedmont Triad could see snow, ice and freezing rain over the weekend and it could con- tinue into Monday.

Original: FOX8 MAX Weather Chief Meteorologist Van Denton said this is a “significant winter weather threat.”
Revised: FOX8 MAX Weather Chief Meteorologist Van Denton said this is a “significant winter weather threat.”

Original: Over the weekend, clouds will again thicken on Saturday as the next system pushes our way.
Revised: Over the weekend, clouds will again thicken on Saturday as the next system pushes our way.

Original: Highs in the upper 30s to near 40.
Revised: Highs in the upper 30s to near 40.

Original: Light precipitation should start arriving over the southwestern coun- ties during the afternoon and reach the Triad during the evening and overnight period.
Revised: Light precipitation should start arriving over the southwestern coun- ties during the afternoon and reach the Triad during the evening and overnight period.

Original: Early on, most precip- itation should fall as rain and as the air cools, it will begin to mix with snow and sleet.
Revised: Early on, most precip- itation should fall as rain and as the air cools, it will begin to mix with snow and sleet.

Original: Overnight Saturday, we expect rain and snow for areas south and east of the
Revised: Overnight Saturday, we expect rain and snow for areas south and east of the

Original: Triad and snow possibly mixed with rain for areas north and west.
Revised: Triad and snow possibly mixed with rain for areas north and west.

Original: Lows in the upper 20s to near 30.
Revised: Lows in the upper 20s to near 30.

Original: For those that are getting rain, there will be freezing rain if these same spots slip below 32.
Revised: For those that are getting rain, there will be freezing rain if these same spots slip below 32.

Original: Near the Triad, we may see our precipitation type change multiple times.
Revised: Near the Triad, we may see our precipitation type change multiple times.

Original: Sunday we expect snow, mixed at times with rain and or sleet and/or freezing rain.
Revised: Sunday we expect snow, mixed at times with rain and or sleet and/or freezing rain.

Original: Highs in the low to mid-30s.
Revised: Highs in the low to mid-30s.

Original: Over the weekend, clouds will again thicken on Sat- urday as the next system pushes our way.
Revised: Over the weekend, clouds will again thicken on Sat- urday as the next system pushes our way.

Original: Highs in the upper 30s to near 40.
Revised: Highs in the upper 30s to near 40.

Original: Light precipitation should start arriving over the southwestern counties during the afternoon and reach the Triad during the evening and overnight period.
Revised: Light precipitation should start arriving over the southwestern counties during the afternoon and reach the Triad during the evening and overnight period.

Original: Early on, most precipitation should fall as rain and as the air cools, it will begin to mix with snow and sleet.
Revised: Early on, most precipitation should fall as rain and as the air cools, it will begin to mix with snow and sleet.

Original: Overnight Saturday, we expect rain and snow for areas south and east of the Triad and snow pos- sibly mixed with rain for areas north and west.
Revised: Overnight Saturday, we expect rain and snow for areas south and east of the Triad and snow pos- sibly mixed with rain for areas north and west.

Original: Lows in the upper 20s to near 30.
Revised: Lows in the upper 20s to near 30.

Original: For those that are getting rain, there will be freezing rain if these same spots slip below 32.
Revised: For those that are getting rain, there will be freezing rain if these same spots slip below 32.

Original: Near the Triad, we may see our precipitation type change multiple times.
Revised: Near the Triad, we may see our precipitation type change multiple times.

Original: Sunday we expect snow, mixed at times with rain and or sleet and or freezing rain.
Revised: Sunday we expect snow, mixed at times with rain and or sleet and or freezing rain.

Original: Highs in the low to mid-30s.
Revised: Highs in the low to mid-30s.

Original: Monday there is still a chance for some snow showers, with lows in the up- per 20s with highs in the mid-30s.
Revised: Monday there is still a chance for some snow showers, with lows in the up- per 20s with highs in the mid-30s.

Original: Dry weather returns for Tuesday through Thursday with rain returning next Friday.
Revised: Dry weather returns for Tuesday through Thursday with rain returning next Friday.

Original: Highs Tuesday through Thursday from nearback to the mid-40s.
Revised: Highs Tuesday through Thursday from nearback to the mid-40s.

Original: We head back to 50 next Friday.
Revised: We head back to 50 next Friday.

Original: Israeli forces use stun grenades and worshippers throw stones during clashes at the mosque in occupied East
Revised: Israeli forces use stun grenades and worshippers throw stones during clashes at the mosque in occupied East

Original: Jerusalem.
Revised: Jerusalem.

Original: Israeli forces raided the mosque compound and fired stun grenades on Friday, while dozens of worshipers threw stones and chanted: “We sacrifice our blood and souls for you Aqsa ”.
Revised: Israeli forces raided the mosque compound and fired stun grenades on Friday, while dozens of worshipers threw stones and chanted: “We sacrifice our blood and souls for you Aqsa ”.

Original: The imam of the mosque, Mohamed Hussian, condemned the violence at one of Islam’s holiest sites - known to Jews as Temple Mount.
Revised: The imam of the mosque, Mohamed Hussian, condemned the violence at one of Islam’s holiest sites - known to Jews as Temple Mount.

Original: “It is a clear violation which is rejected by all the religions and the international laws, ” he said.
Revised: “It is a clear violation which is rejected by all the religions and the international laws, ” he said.

Original: “It is a violation against al-Aqsa mosque and the Israeli authorities are responsible, because they order their soldiers to raid the mosque violently, they are responsible for all what is happening in Al-Aqsa mosque. ”
Revised: “It is a violation against al-Aqsa mosque and the Israeli authorities are responsible, because they order their soldiers to raid the mosque violently, they are responsible for all what is happening in Al-Aqsa mosque. ”

Original: “Israeli police units responded by using stun grenades and en- tering inside the Temple Mount area, immediately we made sure that we dispersed all the rioters. ”
Revised: “Israeli police units responded by using stun grenades and en- tering inside the Temple Mount area, immediately we made sure that we dispersed all the rioters. ”

Original: Clashes have erupted between Israeli forces and wor- shippers at the al-Aqsa mosque compound in occupied East Jerusalem after noon prayers.
Revised: Clashes have erupted between Israeli forces and wor- shippers at the al-Aqsa mosque compound in occupied East Jerusalem after noon prayers.

Original: Israeli forces raided the mosque compound and fired stun grenades on Friday, while dozens of worshipers threw stones and chanted: “We sacrifice our blood and souls for you
Revised: Israeli forces raided the mosque compound and fired stun grenades on Friday, while dozens of worshipers threw stones and chanted: “We sacrifice our blood and souls for you

Original: Aqsa”.
Revised: Aqsa”.

Original: One man was wounded and treated inside the mosque compound.
Revised: One man was wounded and treated inside the mosque compound.

Original: The imam of the mosque, Mohamed Hussian, condemned the violence at one of Is- lam’s holiest sites - known to Jews as Temple Mount.
Revised: The imam of the mosque, Mohamed Hussian, condemned the violence at one of Is- lam’s holiest sites - known to Jews as Temple Mount.

Original: “It is a clear violation which is rejected by all the re- ligions and the international laws,” he said.
Revised: “It is a clear violation which is rejected by all the re- ligions and the international laws,” he said.

Original: Israeli police spokesperson Micky Rosenfeld said police had re- sponded after stones were thrown at them.
Revised: Israeli police spokesperson Micky Rosenfeld said police had re- sponded after stones were thrown at them.

Original: Rosenfeld said police had arrested seven people during the two- hour operation.
Revised: Rosenfeld said police had arrested seven people during the two- hour operation.

Original: The addition of Secure Sockets Layer technology means users will be able to send e-mail that will stay private until it reaches their Internet service provider.
Revised: The addition of Secure Sockets Layer technology means users will be able to send e-mail that will stay private until it reaches their Internet service provider.

Original: After that, the e-mail goes decrypted over the Internet cloud - a space filled with so many billions of bytes, it’s very difficult to spy on a single message.
Revised: After that, the e-mail goes decrypted over the Internet cloud - a space filled with so many billions of bytes, it’s very difficult to spy on a single message.

Original: Eudora’s SSL system then re-encrypts the message at the recipient’s ISP, which gives it the same protection at the receiving end as it had when it was sent.
Revised: Eudora’s SSL system then re-encrypts the message at the recipient’s ISP, which gives it the same protection at the receiving end as it had when it was sent.

Original: “The question is: Where is the attack going to take place? “ said Kawika
Revised: “The question is: Where is the attack going to take place? “ said Kawika

Original: Daguio, president of OS Crypto, a security consulting firm.
Revised: Daguio, president of OS Crypto, a security consulting firm.

Original: “Most of the time, it’s someone watching one of the two parties and not [trying to eavesdrop on] ev- erything.
Revised: “Most of the time, it’s someone watching one of the two parties and not [trying to eavesdrop on] ev- erything.

Original: “ Unfortunately, sophisticated attackers may have other ways of reading people’s e-mail, said David Crocker, director at the Internet Mail Consortium.
Revised: “ Unfortunately, sophisticated attackers may have other ways of reading people’s e-mail, said David Crocker, director at the Internet Mail Consortium.

Original: And while SSL requires no effort by the end user, the fact that mainstream programs such as Eudora are only now adopting it suggests that the state of e-mail security is far behind that of the rest of the Net, he said.
Revised: And while SSL requires no effort by the end user, the fact that mainstream programs such as Eudora are only now adopting it suggests that the state of e-mail security is far behind that of the rest of the Net, he said.

Original: “Security technology in e-mail is very, very poor, ” Crocker said.
Revised: “Security technology in e-mail is very, very poor, ” Crocker said.

Original: Qualcomm, maker of the Eudora e-mail program, an- nounced it will add seamless privacy capabilities to the world’s most popular retail e-mail client.
Revised: Qualcomm, maker of the Eudora e-mail program, an- nounced it will add seamless privacy capabilities to the world’s most popular retail e-mail client.

Original: Qualcomm, maker of the Eudora e-mail program, announced it will add seamless privacy capabilities to the worlds most popular retail e-mail client.
Revised: Qualcomm, maker of the Eudora e-mail program, announced it will add seamless privacy capabilities to the worlds most popular retail e-mail client.

Original: The addition of Secure
Revised: The addition of Secure

Original: Sockets Layer technology means users will be able to send e-mail that will stay private until it reaches their
Revised: Sockets Layer technology means users will be able to send e-mail that will stay private until it reaches their

Original: Internet service provider.
Revised: Internet service provider.

Original: After that, the e-mail goes decrypted over the Internet cloud — a space filled with so many billions of bytes, its very difficult to spy on a single message.
Revised: After that, the e-mail goes decrypted over the Internet cloud — a space filled with so many billions of bytes, its very difficult to spy on a single message.

Original: Eudoras SSL system then re-encrypts the message at the recipients ISP, which gives it the same protection at the receiving end as it had when it was sent.
Revised: Eudoras SSL system then re-encrypts the message at the recipients ISP, which gives it the same protection at the receiving end as it had when it was sent.

Original: “The question is: Where is the attack going to take place? ” said Kawika Daguio, president of OS
Revised: “The question is: Where is the attack going to take place? ” said Kawika Daguio, president of OS

Original: Crypto, a security consulting firm.
Revised: Crypto, a security consulting firm.

Original: “Most of the time, its someone watching one of the two parties and not [trying to eavesdrop on] everything. ”
Revised: “Most of the time, its someone watching one of the two parties and not [trying to eavesdrop on] everything. ”

Original: Unfortunately, sophisticated attackers may have other ways of reading peoples e-mail, said David Crocker, director at the In- ternet Mail Consortium.
Revised: Unfortunately, sophisticated attackers may have other ways of reading peoples e-mail, said David Crocker, director at the In- ternet Mail Consortium.

Original: Reuters An anti-U.S. mural in Tehran, October 2017.
Revised: Reuters An anti-U.S. mural in Tehran, October 2017.

Original: Trump apparently wishes not merely to contain Iran’s power but to roll back its regional presence, confining its influence to its borders, disarming it, and, by implication, changing its regime, given that these are con- straints that Iran’s government could not tolerate for profound strategic and ideological reasons.
Revised: Trump apparently wishes not merely to contain Iran’s power but to roll back its regional presence, confining its influence to its borders, disarming it, and, by implication, changing its regime, given that these are con- straints that Iran’s government could not tolerate for profound strategic and ideological reasons.

Original: Doing so would take a massive effort and likely entail another
Revised: Doing so would take a massive effort and likely entail another

Original: American war in the Middle East—one that the presi- dent is not committed to fighting and would not have the popular support to pursue.
Revised: American war in the Middle East—one that the presi- dent is not committed to fighting and would not have the popular support to pursue.

Original: Rather than a coherent strat- egy, Trump’s aggressive behavior reflects a strange and unhealthy obsession with Iran unwarranted by the ac- tual threat it poses to the interests of the United States and its allies.
Revised: Rather than a coherent strat- egy, Trump’s aggressive behavior reflects a strange and unhealthy obsession with Iran unwarranted by the ac- tual threat it poses to the interests of the United States and its allies.

Original: The risk now is that the United States could drift into a war with Iran in a fog of bombastic threats and jolting policy reversals even if there were no underlying interest in hostilities.
Revised: The risk now is that the United States could drift into a war with Iran in a fog of bombastic threats and jolting policy reversals even if there were no underlying interest in hostilities.

Original: But although Trump’s rhetoric is dangerous, his administration’s inordinate antagonism is rooted in a deeper inability, going all the way back to 1979, of the United States to find a way forward with Iran.
Revised: But although Trump’s rhetoric is dangerous, his administration’s inordinate antagonism is rooted in a deeper inability, going all the way back to 1979, of the United States to find a way forward with Iran.

Original: It is time for Washington to do so before it is too late.
Revised: It is time for Washington to do so before it is too late.

Original: STEVEN SIMON is a Professor at Amherst Col- lege and served on the National Security Council in the Clinton and Obama administrations.
Revised: STEVEN SIMON is a Professor at Amherst Col- lege and served on the National Security Council in the Clinton and Obama administrations.

Original: JONATHAN STEVENSON is Senior Fellow for U.S. Defense and
Revised: JONATHAN STEVENSON is Senior Fellow for U.S. Defense and

Original: Editor of Strategic Comments at the International In- stitute for Strategic Studies.
Revised: Editor of Strategic Comments at the International In- stitute for Strategic Studies.

Original: He served as Director for
Revised: He served as Director for

Original: Political-Military Affairs for the Middle East and North Africa on the U.S. National Security Council staff from 2011 to 2013.
Revised: Political-Military Affairs for the Middle East and North Africa on the U.S. National Security Council staff from 2011 to 2013.

Original: Trump apparently wishes not merely to contain Iran’s power but to roll back its regional presence, confining its influence to its borders, disarming it, and, by implication, changing its regime , given that these are constraints that Iran’s government could not tolerate for profound strategic and ideological reasons.
Revised: Trump apparently wishes not merely to contain Iran’s power but to roll back its regional presence, confining its influence to its borders, disarming it, and, by implication, changing its regime , given that these are constraints that Iran’s government could not tolerate for profound strategic and ideological reasons.

Original: Doing so would take a massive effort and likely entail another American war in the Middle East—one that the president is not committed to fighting and would not have the popular support to pursue.
Revised: Doing so would take a massive effort and likely entail another American war in the Middle East—one that the president is not committed to fighting and would not have the popular support to pursue.

Original: Rather than a coherent strategy, Trump’s aggressive behavior reflects a strange and unhealthy obsession with Iran unwarranted by the actual threat it poses to the interests of the United States and its allies.
Revised: Rather than a coherent strategy, Trump’s aggressive behavior reflects a strange and unhealthy obsession with Iran unwarranted by the actual threat it poses to the interests of the United States and its allies.

Original: According to the District of Columbia ’s Metropoli- tan Police Department, the nation’s capital reportedhomicides last year.
Revised: According to the District of Columbia ’s Metropoli- tan Police Department, the nation’s capital reportedhomicides last year.

Original: One of those homicides, the killing of Democratic National Committee staffer Seth Rich on
Revised: One of those homicides, the killing of Democratic National Committee staffer Seth Rich on

Original: July 10, 2016, continues to make news ten months later.
Revised: July 10, 2016, continues to make news ten months later.

Original: Who killed Seth Rich, and why?
Revised: Who killed Seth Rich, and why?

Original: We may never know for sure.
Revised: We may never know for sure.

Original: On the other hand, a significant piece of the puzzle may have just fallen into place.
Revised: On the other hand, a significant piece of the puzzle may have just fallen into place.

Original: Fox News, citing a federal investigator as a source, reports that Rich may well — as long rumored — have been the source of DNC emails published by WikiLeaks, less than two weeks after he was shot twice in the back during a robbery in which, curiously, nothing was apparently taken from him.
Revised: Fox News, citing a federal investigator as a source, reports that Rich may well — as long rumored — have been the source of DNC emails published by WikiLeaks, less than two weeks after he was shot twice in the back during a robbery in which, curiously, nothing was apparently taken from him.

Original: That email release, which revealed an internal DNC conspiracy to ensure the nomination of Hillary Clinton for president at the expense of her opponent,
Revised: That email release, which revealed an internal DNC conspiracy to ensure the nomination of Hillary Clinton for president at the expense of her opponent,

Original: Bernie Sanders, wounded Clinton’s campaign and cost US Representative
Revised: Bernie Sanders, wounded Clinton’s campaign and cost US Representative

Original: Debbie Wasserman Schultz her position as DNC chair.
Revised: Debbie Wasserman Schultz her position as DNC chair.

Original: Fox News, citing a federal investigator as source,
Revised: Fox News, citing a federal investigator as source,

Original: re-
Revised: re-

Original: ports that Rich may well - as long rumored - have been the source of DNC emails published by Wik- iLeaks, less than two weeks after he was shot twice in the back during a robbery in which, curiously, noth- ing was apparently taken from him.
Revised: ports that Rich may well - as long rumored - have been the source of DNC emails published by Wik- iLeaks, less than two weeks after he was shot twice in the back during a robbery in which, curiously, noth- ing was apparently taken from him.

Original: That email release, which revealed an internal DNC conspiracy to en- sure the nomination of Hillary Clinton for president at the expense of her opponent, Bernie Sanders, wounded Clinton’s campaign and cost US Representative Debbie
Revised: That email release, which revealed an internal DNC conspiracy to en- sure the nomination of Hillary Clinton for president at the expense of her opponent, Bernie Sanders, wounded Clinton’s campaign and cost US Representative Debbie

Original: Wasserman-Schultz her position as DNC chair.
Revised: Wasserman-Schultz her position as DNC chair.

Original: Wik-
Revised: Wik-

Original: iLeaks founder/director Julian Assange, in line with the organization’s policy against outing sources, has reso- lutely declined to confirm or deny Rich as the DNC leaker.
Revised: iLeaks founder/director Julian Assange, in line with the organization’s policy against outing sources, has reso- lutely declined to confirm or deny Rich as the DNC leaker.

Original: On the other hand, WikiLeaks did put up re- ward money for information leading to the arrest and conviction of his killer or killers - and retweeted, with- out comment, the Fox News story referenced above.
Revised: On the other hand, WikiLeaks did put up re- ward money for information leading to the arrest and conviction of his killer or killers - and retweeted, with- out comment, the Fox News story referenced above.

Original: have two articles (the modal value).
Revised: articles (the modal value).

Original: Two pairs appear to be actual duplicates, while the other three contain similar topics, but are not duplicated.
Revised: Two pairs appear to be actual duplicates, while the other three contain similar topics, but are not duplicated.

Original: Some articles have been truncated.
Revised: Some articles have been truncated.

Original: 2014-10-01 Assigned to HAND HELD PRODUCTS, INC. reassignment HAND HELD PRODUCTS, INC.
Revised: 2014-10-01 Assigned to HAND HELD PRODUCTS, INC. reassignment HAND HELD PRODUCTS, INC.

Original: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors:
Revised: Assignors:

Original: QU, HUYU, WANG,
Revised: QU, HUYU, WANG,

Original: YNJIUN P. A portable encoded information reading (EIR) terminal for incorporation in a data collection system having a host computer, a 
Revised: YNJIUN P. A portable encoded information reading (EIR) terminal for incorporation in a data collection system having a host computer, a plurality of peer EIR terminals, and a plurality of inter- connected networks including one or more wireless networks, can comprise a central processing unit (CPU), a memory, an encoded information reading (EIR) device, and at least one wireless communication interface.

Original: plu-

Original: rality of

Original: peer EIR

Original: terminals, and a plurality of

Original: inter-

Original: connected networks

Original: including one or more wireless net-

Original: works, can comprise a

Original: central processing unit (CPU)

Original: a memory

Original: an encoded information reading (EIR) device

Original: , and

Original: at

Original: least

Original: one wireless communication interface. The EIR terminal can be associated with a home network 
Revised: The EIR terminal can be associated with a home network and have a home address belonging to the address range associated with the home network.

Original: and have

Original: a home

Original: address belonging

Original: to the address

Original: range associated

Original: with the home network

Original: The EIR terminal

Original: can participate

Original: in one

Original: or

Original: more communication sessions

Original: and exchange messages

Original: , at

Original: least

Original: one of

Original: which

Original: can in-

Original: clude

Original:  decoded message data corresponding to an en- coded message with the host computer
Revised: The EIR terminal can participate in one or more communication sessions and exchange messages, at least one of which can include decoded message data corresponding to an en- coded message, with the host computer.

Original: 2010-07-02 Assigned to HAND HELD PRODUCTS, INC. reassignment HAND HELD PRODUCTS, INC.
Revised: 2010-07-02 Assigned to HAND HELD PRODUCTS, INC. reassignment HAND HELD PRODUCTS, INC.

Original: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors:
Revised: Assignors:

Original: QU, HUYU, WANG, YNJIUN P., HAVENS, WILLIAM
Revised: QU, HUYU, WANG, YNJIUN P., HAVENS, WILLIAM

Original: H
Revised: H. A portable data terminal (PDT) adapted to partici-

Original: A portable data terminal (PDT) adapted to partici- pate in a wireless mesh networkincluding a plurality of peer PDTs can comprise: a PDT module includ- ing an encoded information reading (EIR) device, and a mesh point (MP) module communicatively coupled to the PDT module.
Revised: pate in a wireless mesh network

Original: The MP module can include a microcontroller and at least one wireless communica- tion interface and canbe configured to perform IEEE 802.11-conformant wireless station services including authentication, de-authentication, privacy, and MAC
Revised: including a plurality of peer PDTs can

Original: service
Revised: comprise

Original: data
Revised: a PDT module includ- ing an encoded information reading

Original: unit delivery, and IEEE
Revised: (EIR device , and a

Original: -conformant wireless distribution system services including associ
Revised: mesh point (MP) module communicatively coupled to the

Original: - ation, disassociation, distribution, integration,
Revised: PDT module.

Original: and
Revised: The

Original: re association
Revised: MP module can include a microcontroller and at least one wireless communica- tion interface and can be configured to perform IEEE 802.11-conformant wireless station services including authentication, de-authentication, privacy, and MAC service data unit delivery, and IEEE 802.11-conformant wireless distribution system services including association, disassociation, distribution, integration, and re- association

Original: An instrument useful in performing lumbar arthrodesis with a minimal approach which spares the lumbar muscles from surgical disruption and includes one of two retractor designs having blades angled approximately 90˘00b0 with respect to each respective retractor handle.
Revised: An instrument useful in performing lumbar arthrodesis with a minimal approach which spares the lumbar muscles from surgical disruption and includes one of two retractor designs having blades angled approximately 90˘00b0 with respect to each respective retractor handle.

Original: One blade is bent at an end portion thereof in a direc- tion away from the handle portion.
Revised: One blade is bent at an end portion thereof in a direc- tion away from the handle portion.

Original: The other blade has first and second blade faces, with the second face hav- ing at least two toothed structures located thereon.
Revised: The other blade has first and second blade faces, with the second face hav- ing at least two toothed structures located thereon.

Original: This application is a continuation of U.S. patent application Ser.
Revised: This application is a continuation of U.S. patent application Ser.

Original: No. 09/969,138 filed on Oct. 1, 2001 and entitled “METHOD AND DEVICE FOR RETRACTOR FOR MICROSURGICAL INTERMUSCULAR LUMBAR ARTHRODESIS”, now U.S. Pat.
Revised: No. 09/969,138 filed on Oct. 1, 2001 and entitled “METHOD AND DEVICE FOR RETRACTOR FOR MICROSURGICAL INTERMUSCULAR LUMBAR ARTHRODESIS”, now U.S. Pat.

Original: No. 6,692,
Revised: No. 6,692,

Original: This application is a continuation of U.S. patent ap- plication Ser.
Revised: This application is a continuation of U.S. patent ap- plication Ser.

Original: No.
Revised: No.

Original: 09/969,138 filed on Oct.
Revised: 09/969,138 filed on Oct.

Original: 1, 2001 and entitled “METHOD AND DEVICE FOR RETRACTOR FOR MICROSURGICAL INTERMUS- CULAR LUMBAR ARTHRODESIS”, which claimed priority from U.S. Provisional Patent Application No. 60/236,584 filed on Sep. 29, 2000.
Revised: 1, 2001 and entitled “METHOD AND DEVICE FOR RETRACTOR FOR MICROSURGICAL INTERMUS- CULAR LUMBAR ARTHRODESIS”, which claimed priority from U.S. Provisional Patent Application No. 60/236,584 filed on Sep. 29, 2000.

Original: The entire disclosures of these applications are considered to be part of the disclosure of the present application and are hereby incorporated by reference in their entirety.
Revised: The entire disclosures of these applications are considered to be part of the disclosure of the present application and are hereby incorporated by reference in their entirety.

Original: The present invention is directed to a method and device for performing an instrumented lumbar interbody fusion uti-
Revised: The present invention is directed to a method and device for performing an instrumented lumbar interbody fusion uti-

Original: lizing a minimally invasive approach.
Revised: lizing a minimally invasive approach.

Original: 2007-02-13 Assigned to 3M INNOVATIVE PROP- ERTIES COMPANY reassignment 3M INNOVATIVE
Revised: 2007-02-13 Assigned to 3M INNOVATIVE PROP- ERTIES COMPANY reassignment 3M INNOVATIVE

Original: PROPERTIES COMPANY ASSIGNMENT OF AS- SIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: PROPERTIES COMPANY ASSIGNMENT OF AS- SIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors: VOS, MARTIN J. An untethered stylus, configured to cooperate with a location sensor, includes a coil resonant circuit configured to develop an arbitrary AC voltage in response to a varying magnetic field produced by the location sensor.
Revised: Assignors: VOS, MARTIN J. An untethered stylus, configured to cooperate with a location sensor, includes a coil resonant circuit configured to develop an arbitrary AC voltage in response to a varying magnetic field produced by the location sensor.

Original: The coil resonant circuit includes a first capacitor and an inductive coil.
Revised: The coil resonant circuit includes a first capacitor and an inductive coil.

Original: A power converter includes a switch circuit having an output coupled to a second capacitor, an input coupled to the coil resonant circuit, and a threshold voltage.
Revised: A power converter includes a switch circuit having an output coupled to a second capacitor, an input coupled to the coil resonant circuit, and a threshold voltage.

Original: The switch circuit facilitates charging of the second capacitor in response to the arbitrary AC volt- age and discontinuance of second capacitor charging in response to a voltage across the first capacitor reaching the threshold voltage so as to prevent diversion of a discharging current when the arbitrary AC voltage exceeds the threshold voltage.
Revised: The switch circuit facilitates charging of the second capacitor in response to the arbitrary AC volt- age and discontinuance of second capacitor charging in response to a voltage across the first capacitor reaching the threshold voltage so as to prevent diversion of a discharging current when the arbitrary AC voltage exceeds the threshold voltage.

Original: A stable DC voltage is provided at the output of the switch circuit.
Revised: A stable DC voltage is provided at the output of the switch circuit.

Original: The power converter is preferably devoid of a Zener diode.
Revised: The power converter is preferably devoid of a Zener diode.

Original: 2007-03-19 Assigned to 3M INNOVATIVE PROP- ERTIES COMPANY reassignment 3M INNOVATIVE
Revised: 2007-03-19 Assigned to 3M INNOVATIVE PROP- ERTIES COMPANY reassignment 3M INNOVATIVE

Original: PROPERTIES COMPANY ASSIGNMENT OF AS- SIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: PROPERTIES COMPANY ASSIGNMENT OF AS- SIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors: LIBBEY, ALBERT H., VOS, MARTIN J. An untethered stylus is configured to cooperate with a location sensing device that generates a continuously varying magnetic drive signal that powers the stylus.
Revised: Assignors: LIBBEY, ALBERT H., VOS, MARTIN J. An untethered stylus is configured to cooperate with a location sensing device that generates a continuously varying magnetic drive signal that powers the stylus.

Original: The stylus includes a housing having a tip, a shield, and an antenna arrangement coupled between the tip and shield.
Revised: The stylus includes a housing having a tip, a shield, and an antenna arrangement coupled between the tip and shield.

Original: A resonant circuit of the antenna ar- rangement is tuned to a frequency of the magnetic drive signal.
Revised: A resonant circuit of the antenna ar- rangement is tuned to a frequency of the magnetic drive signal.

Original: An oscillator circuit, coupled to and powered by the antenna arrangement, is configured to oscillate at a frequency corresponding to data to be communi- cated from the stylus, and to amplitude modulate a voltage developed at the stylus tip at the oscillator circuit frequency.
Revised: An oscillator circuit, coupled to and powered by the antenna arrangement, is configured to oscillate at a frequency corresponding to data to be communi- cated from the stylus, and to amplitude modulate a voltage developed at the stylus tip at the oscillator circuit frequency.

Original: Repetitive current draw from the antenna arrangement to power the oscillator circuit repetitively reduces a voltage at the tip, such that the tip voltage is amplitude modulated at the oscillator circuit frequency.
Revised: Repetitive current draw from the antenna arrangement to power the oscillator circuit repetitively reduces a voltage at the tip, such that the tip voltage is amplitude modulated at the oscillator circuit frequency.

Original: 2002-03-13 Assigned to TESSERA, INC. reassignment TESSERA, INC.
Revised: 2002-03-13 Assigned to TESSERA, INC. reassignment TESSERA, INC.

Original: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT
Revised: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT

Original: FOR DETAILS).
Revised: FOR DETAILS).

Original: Assignors: PICK- ETT, CHRISTOPHER M., SMITH,
Revised: Assignors: PICK- ETT, CHRISTOPHER M., SMITH,

Original: JOHN W. A microelectronic as- sembly is made by bonding the tip ends of leads on a first element to bonding contacts on a second element.
Revised: JOHN W. A microelectronic as- sembly is made by bonding the tip ends of leads on a first element to bonding contacts on a second element.

Original: The tip ends of the leads are releasably connected to the first element, so that the leads are held in place during the bonding process.
Revised: The tip ends of the leads are releasably connected to the first element, so that the leads are held in place during the bonding process.

Original: After bonding, the first and second elements are heated or cooled to cause differential thermal expansion, which breaks at least some of the releasable attachments of the tip ends, leaving the leads free to flex.
Revised: After bonding, the first and second elements are heated or cooled to cause differential thermal expansion, which breaks at least some of the releasable attachments of the tip ends, leaving the leads free to flex.

Original: 2009-05-06 Assigned to TESSERA, INC. reassignment TESSERA, INC.
Revised: 2009-05-06 Assigned to TESSERA, INC. reassignment TESSERA, INC.

Original: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT
Revised: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT

Original: FOR
Revised: FOR

Original: DETAILS).
Revised: DETAILS).

Original: Assignors: FJELSTAD, JOSEPH C. A microelectronic assembly is provided which can include an element including a first dielectric layer and a second dielectric layer overlying the first dielectric layer, the second dielectric layer having an exposed surface defining an exposed major surface of the element.
Revised: Assignors: FJELSTAD, JOSEPH C. A microelectronic assembly is provided which can include an element including a first dielectric layer and a second dielectric layer overlying the first dielectric layer, the second dielectric layer having an exposed surface defining an exposed major surface of the element.

Original: A plurality of substantially rigid metal posts can project beyond the exposed surface, the metal posts having ends remote from the exposed surface.
Revised: A plurality of substantially rigid metal posts can project beyond the exposed surface, the metal posts having ends remote from the exposed surface.

Original: The microelectronic assembly can include a microelectronic device which has bond pads and overlies the element.
Revised: The microelectronic assembly can include a microelectronic device which has bond pads and overlies the element.

Original: 1996-12-27 Assigned to TESSERA, INC. reassignment TESSERA, INC.
Revised: 1996-12-27 Assigned to TESSERA, INC. reassignment TESSERA, INC.

Original: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT
Revised: ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT

Original: FOR
Revised: FOR

Original: DETAILS).
Revised: DETAILS).

Original: Assignors: GILLEO, KENNETH B. A microelectronic element assembly such as a semiconductor chip assembly uses a connection component in- corporating a dielectric sheet with electrically conductive elements therein.
Revised: Assignors: GILLEO, KENNETH B. A microelectronic element assembly such as a semiconductor chip assembly uses a connection component in- corporating a dielectric sheet with electrically conductive elements therein.

Original: Each electrically conductive element may include a flexible shell.
Revised: Each electrically conductive element may include a flexible shell.

Original: The flexible shells can be formed to assure reliable engagement with mating contact pads.
Revised: The flexible shells can be formed to assure reliable engagement with mating contact pads.

Original: The present application claims benefit of U.S. Provisional Application No. 60/001,669, filed Jul. 31, 1995.
Revised: The present application claims benefit of U.S. Provisional Application No. 60/001,669, filed Jul. 31, 1995.

Original: The present invention relates in cer- tain embodiments to methods, systems, and devices for treating verte- bral compression fractures.
Revised: The present invention relates in cer- tain embodiments to methods, systems, and devices for treating verte- bral compression fractures.

Original: In one embodiment, a bone cement injec- tor is advanced into bone and injects a bone cement flow through the in- jector and a vapor flow from at least one vapor outlet in the injector.
Revised: In one embodiment, a bone cement injec- tor is advanced into bone and injects a bone cement flow through the in- jector and a vapor flow from at least one vapor outlet in the injector.

Original: In another embodiment, the bone treatment system comprises an elongated member having a flow passageway, a bone fill material source, and a vapor source coupleable to the flow passageway.
Revised: In another embodiment, the bone treatment system comprises an elongated member having a flow passageway, a bone fill material source, and a vapor source coupleable to the flow passageway.

Original: Systems and methods for treating vertebral compression fractures are provided.
Revised: Systems and methods for treating vertebral compression fractures are provided.

Original: In one embodiment, a bone cement injector system can include a first handle component that is detachably coupled to a second sleeve component having a distal end configured for positioning in bone, and a flow channel extending through the first and second components.
Revised: In one embodiment, a bone cement injector system can include a first handle component that is detachably coupled to a second sleeve component having a distal end configured for positioning in bone, and a flow channel extending through the first and second components.

Original: The system can include a thermal energy emitter.
Revised: The system can include a thermal energy emitter.

Original: The flow channel can have a flow channel sur- face with a material that that limits cement flow turbulence.
Revised: The flow channel can have a flow channel sur- face with a material that that limits cement flow turbulence.

Original: The present invention relates in cer- tain embodiments to systems for treating vertebral compression frac- tures.
Revised: The present invention relates in cer- tain embodiments to systems for treating vertebral compression frac- tures.

Original: In one embodiment, a trocar with a flexible tip is provided to create a curved path in cancellous bone.
Revised: In one embodiment, a trocar with a flexible tip is provided to create a curved path in cancellous bone.

Original: An injector can be intro- duced into the vertebra in communication with the curved path for de- livery of bone fill material into the curved path.
Revised: An injector can be intro- duced into the vertebra in communication with the curved path for de- livery of bone fill material into the curved path.

Original: Optionally, thermal en- ergy can be applied to the bone fill material prior to injection into the curved path in cancellous bone to alter a property (e.g., viscosity) of the bone fill material.
Revised: Optionally, thermal en- ergy can be applied to the bone fill material prior to injection into the curved path in cancellous bone to alter a property (e.g., viscosity) of the bone fill material.

Original: An optical amplifier of a wavelength-division multi- plexing transmission system that includes a pre-stage optical amplifying unit and a post stage optical ampli- fying unit.
Revised: An optical amplifier of a wavelength-division multi- plexing transmission system that includes a pre-stage optical amplifying unit and a post stage optical ampli- fying unit.

Original: The pre-stage optical amplifying unit has a rare-earth element doped optical fiber and a pump light source for inputting a pump light to the rare-earth element doped optical fiber.
Revised: The pre-stage optical amplifying unit has a rare-earth element doped optical fiber and a pump light source for inputting a pump light to the rare-earth element doped optical fiber.

Original: The post-stage optical ampli- fying unit has a second rare-earth element doped optical fiber and a pump light source for inputting a pump light to the second rare-earth element doped optical fiber.
Revised: The post-stage optical ampli- fying unit has a second rare-earth element doped optical fiber and a pump light source for inputting a pump light to the second rare-earth element doped optical fiber.

Original: A wavelength-division multiplexing optical commu- nication system for wavelength-division multiplexing a plurality of optical signals having different wave- lengths and transmitting a wavelength-division multiplexed signal via an optical fiber transmission line.
Revised: A wavelength-division multiplexing optical commu- nication system for wavelength-division multiplexing a plurality of optical signals having different wave- lengths and transmitting a wavelength-division multiplexed signal via an optical fiber transmission line.

Original: The wavelength-division multiplexing system includes a multiplexing unit that wavelength-multiplexes a plu- rality of optical signals having different wavelengths.
Revised: The wavelength-division multiplexing system includes a multiplexing unit that wavelength-multiplexes a plu- rality of optical signals having different wavelengths.

Original: A storing unit stores information regarding an addition or subtraction of an optical signal to be wavelengthmultiplexed
Revised: A storing unit stores information regarding an addition or subtraction of an optical signal to be wavelengthmultiplexed

Original: Methods, apparatuses and systems directed to spon- sored story generation from an organic activity stream in a social networking site.
Revised: Methods, apparatuses and systems directed to spon- sored story generation from an organic activity stream in a social networking site.

Original: A user wishing to pro- mote an entry from an organic activity stream may, using a sponsor user interface, specify the types of sto- ries to promote to a portion of the home page displayed to a member of a social network.
Revised: A user wishing to pro- mote an entry from an organic activity stream may, using a sponsor user interface, specify the types of sto- ries to promote to a portion of the home page displayed to a member of a social network.

Original: This appli- cation is a continuation-in-part of application Ser.
Revised: This appli- cation is a continuation-in-part of application Ser.

Original: No.
Revised: No.

Original: 12/193,702, filed Aug. 18, 2008, which claims priority to U.S. Provisional Application Ser.
Revised: 12/193,702, filed Aug. 18, 2008, which claims priority to U.S. Provisional Application Ser.

Original: No. 60/985,631, filed Nov. 5, 2007.
Revised: No. 60/985,631, filed Nov. 5, 2007.

Original: A method includes monitoring an activity stream to identify actions that match stored sponsored story specifications, for providing one or more sponsored stories to a viewing user.
Revised: A method includes monitoring an activity stream to identify actions that match stored sponsored story specifications, for providing one or more sponsored stories to a viewing user.

Original: The sponsored story specifications include a visual specification for the sponsored story, and matched sponsored stories are ranked for a viewing user.
Revised: The sponsored story specifications include a visual specification for the sponsored story, and matched sponsored stories are ranked for a viewing user.

Original: Users can set privacy preferences related to sponsored stories.
Revised: Users can set privacy preferences related to sponsored stories.

Original: The ranking and privacy settings contribute to which sponsored stories are provided for display to the viewing user.
Revised: The ranking and privacy settings contribute to which sponsored stories are provided for display to the viewing user.

Original: This application is a continuation of U.S. patent application Ser.
Revised: This application is a continuation of U.S. patent application Ser.

Original: No. 13/488,596, filed Jun. 5, 2012, 1999-12-23 Assigned to 3COM CORPORATION reas- signment 3COM CORPORATION ASSIGNMENT OF
Revised: No. 13/488,596, filed Jun. 5, 2012, 1999-12-23 Assigned to 3COM CORPORATION reas- signment 3COM CORPORATION ASSIGNMENT OF

Original: ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors: BELKIND, RONNEN, GRABIEC, JACEK A., SIDHU, IKHLAQ S., SCHUSTER, GUIDO M. 2013-05-23 Assigned to QUALCOMM INCORPORATED reassignment QUALCOMM INCOR-
Revised: Assignors: BELKIND, RONNEN, GRABIEC, JACEK A., SIDHU, IKHLAQ S., SCHUSTER, GUIDO M. 2013-05-23 Assigned to QUALCOMM INCORPORATED reassignment QUALCOMM INCOR-

Original: PORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: PORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: 2000-08-23 Assigned to 3COM CORPORATION
Revised: 2000-08-23 Assigned to 3COM CORPORATION

Original: re-
Revised: re-

Original: assignment 3COM CORPORATION ASSIGNMENT
Revised: assignment 3COM CORPORATION ASSIGNMENT

Original: OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors: DEAN, FREDERICK D.,
Revised: Assignors: DEAN, FREDERICK D.,

Original: GRABIEC, JACEK A., MAHLER, JERRY J., SCHUS- TER, GUIDO M., SIDHU, IKHLAQ S. A system and method for communicating screen display images on a computer to another computer using a telephony network.
Revised: GRABIEC, JACEK A., MAHLER, JERRY J., SCHUS- TER, GUIDO M., SIDHU, IKHLAQ S. A system and method for communicating screen display images on a computer to another computer using a telephony network.

Original: A screen share button on a data network tele- phone initiates a screen shot request to a first computer associated with the data network telephone.
Revised: A screen share button on a data network tele- phone initiates a screen shot request to a first computer associated with the data network telephone.

Original: A catheter assembly employs an outer catheter with a pre-formed distal end and an open lumen.
Revised: A catheter assembly employs an outer catheter with a pre-formed distal end and an open lumen.

Original: An inner catheter having an open lumen and a pre-formed dis- tal end is movably disposed within the outer catheter.
Revised: An inner catheter having an open lumen and a pre-formed dis- tal end is movably disposed within the outer catheter.

Original: Relative rotation and extension of the inner and outer catheters provides the distal end of the catheter assembly with an adjustable range of two- and three- dimensional shapes.
Revised: Relative rotation and extension of the inner and outer catheters provides the distal end of the catheter assembly with an adjustable range of two- and three- dimensional shapes.

Original: The inner catheter can include sections of varying stiffness, such that extension of the in- ner catheter within the outer catheter modifies the shape of the outer catheter’s pre-formed distal end.
Revised: The inner catheter can include sections of varying stiffness, such that extension of the in- ner catheter within the outer catheter modifies the shape of the outer catheter’s pre-formed distal end.

Original: A method of delivering a payload to a destination ves-
Revised: A method of delivering a payload to a destination ves-

Original: sel branching from a coronary sinus of a patient’s heart.
Revised: sel branching from a coronary sinus of a patient’s heart.

Original: The method comprises inserting a catheter assembly into a right atrium of the patient’s heart.
Revised: The method comprises inserting a catheter assembly into a right atrium of the patient’s heart.

Original: The catheter assembly comprises an outer catheter and an inner catheter movably disposed within the open lumen of the outer catheter.
Revised: The catheter assembly comprises an outer catheter and an inner catheter movably disposed within the open lumen of the outer catheter.

Original: The inner and outer catheters are oper- able to be rotated and translated relative to one another such that the distal end of the outer catheter can assume a selectable plurality of shapes appropriate for accessing the coronary sinus.
Revised: The inner and outer catheters are oper- able to be rotated and translated relative to one another such that the distal end of the outer catheter can assume a selectable plurality of shapes appropriate for accessing the coronary sinus.

Original: The present invention relates to high-throughput sys- tems for analyzing samples by both liquid chromatography and mass spectrometry.
Revised: The present invention relates to high-throughput sys- tems for analyzing samples by both liquid chromatography and mass spectrometry.

Original: Mass spectrometry (MS) is an important analysis technique in many industrial and academic fields.
Revised: Mass spectrometry (MS) is an important analysis technique in many industrial and academic fields.

Original: MS exploits the behavior of the gas-phase ions (i.e., gaseous molecules with a non-zero charge) of a molecule in response to applied electric and magnetic fields in order to deduce the composition of the molecule.
Revised: MS exploits the behavior of the gas-phase ions (i.e., gaseous molecules with a non-zero charge) of a molecule in response to applied electric and magnetic fields in order to deduce the composition of the molecule.

Original: The ionization process breaks a molecule into its components, the mass of each of which is then determined by analyzing the trajectory of the compo- nents as they travel through the mass spectrometer.
Revised: The ionization process breaks a molecule into its components, the mass of each of which is then determined by analyzing the trajectory of the compo- nents as they travel through the mass spectrometer.

Original: 2003-08-18 Assigned to NANOSTREAM, INC. reas- signment NANOSTREAM, INC. ASSIGNMENT OF
Revised: 2003-08-18 Assigned to NANOSTREAM, INC. reas- signment NANOSTREAM, INC. ASSIGNMENT OF

Original: ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).
Revised: ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).

Original: Assignors: COVINGTON, JOSEPH F.,
Revised: Assignors: COVINGTON, JOSEPH F.,

Original: GREGORI, MATTHEW M., HOBBS, STEVEN E. Systems and methods for collecting the output of multiple simultaneously operated chromatography columns and providing the outputs to a single mass spectrometer are provided.
Revised: GREGORI, MATTHEW M., HOBBS, STEVEN E. Systems and methods for collecting the output of multiple simultaneously operated chromatography columns and providing the outputs to a single mass spectrometer are provided.

Original: Such systems utilize predetermined lengths of microfluidic tubing that act as storage buffers for the substantially all of the output of each column.
Revised: Such systems utilize predetermined lengths of microfluidic tubing that act as storage buffers for the substantially all of the output of each column.

Original: All five clusters happened to have two patents.
Revised: All five clusters happened to have two patents.

Original: The patents share some similarities, and the third example contains duplicated boilerplate language, but none of them are obvious duplicates.
Revised: The patents share some similarities, and the third example contains duplicated boilerplate language, but none of them are obvious duplicates.

Original: All patents have been truncated
Revised: All patents have been truncated

Original: Fossil fuel – A fossil fuel is a fuel formed by natural processes, such as anaerobic decomposition of buried dead organisms, containing energy originating in an- cient photosynthesis.
Revised: Fossil fuel – A fossil fuel is a fuel formed by natural processes, such as anaerobic decomposition of buried dead organisms, containing energy originating in an- cient photosynthesis.

Original: The age of the organisms and their resulting fossil fuels is typically millions of years, and sometimes exceeds 650 million years.
Revised: The age of the organisms and their resulting fossil fuels is typically millions of years, and sometimes exceeds 650 million years.

Original: Fossil fuels are fuels formed by natural processes such as anaerobic decomposition of buried dead organisms.
Revised: Fossil fuels are fuels formed by natural processes such as anaerobic decomposition of buried dead organisms.

Original: The age of the organisms and their resulting fossil fuels is typically millions of years, and sometimes exceeds 650 million years.
Revised: The age of the organisms and their resulting fossil fuels is typically millions of years, and sometimes exceeds 650 million years.

Original: Fossil fuels contain high percentages of carbon and include coal, petroleum, and natural gas.
Revised: Fossil fuels contain high percentages of carbon and include coal, petroleum, and natural gas.

Original: Kennedy Space Center – The John F. Kennedy Space Center (KSC, originally known as the NASA Launch
Revised: Kennedy Space Center – The John F. Kennedy Space Center (KSC, originally known as the NASA Launch

Original: Operations Center) is one of ten National Aeronautics and Space Administration field centers.
Revised: Operations Center) is one of ten National Aeronautics and Space Administration field centers.

Original: Since December 1968, Kennedy Space Center has been NASA’s pri- mary launch center of human spaceflight.
Revised: Since December 1968, Kennedy Space Center has been NASA’s pri- mary launch center of human spaceflight.

Original: Launch operations for the Apollo, Skylab and Space Shuttle pro- grams were carried out from Kennedy Space Center
Revised: Launch operations for the Apollo, Skylab and Space Shuttle pro- grams were carried out from Kennedy Space Center

Original: Launch Complex 39 and managed by KSC.
Revised: Launch Complex 39 and managed by KSC.

Original: The John F. Kennedy Space Center is one of ten Na- tional Aeronautics and Space Administration field centers.
Revised: The John F. Kennedy Space Center is one of ten Na- tional Aeronautics and Space Administration field centers.

Original: Since December 1968, Kennedy Space Center has been NASA’s primary launch center of human spaceflight.
Revised: Since December 1968, Kennedy Space Center has been NASA’s primary launch center of human spaceflight.

Original: Launch operations for the Apollo, Skylab and Space Shuttle programs were carried out from Kennedy
Revised: Launch operations for the Apollo, Skylab and Space Shuttle programs were carried out from Kennedy

Original: Space Center Launch Complex 39 and managed by KSC.
Revised: Space Center Launch Complex 39 and managed by KSC.

Original: Washington (CNN)
Revised: Washington (CNN)

Original: Donald Trump said Sunday that Russian President Vladimir Putin won’t make a military move into Ukraine – even though Putin already has done just that, seizing the country’s Crimean Peninsula.
Revised: Donald Trump said Sunday that Russian President Vladimir Putin won’t make a military move into Ukraine – even though Putin already has done just that, seizing the country’s Crimean Peninsula.

Original: “He’s not going into Ukraine, OK, just so you under- stand.
Revised: “He’s not going into Ukraine, OK, just so you under- stand.

Original: He’s not going to go into Ukraine, all right?
Revised: He’s not going to go into Ukraine, all right?

Original: You can mark it down.
Revised: You can mark it down.

Original: You can put it down.
Revised: You can put it down.

Original: You can take it anywhere you want,” Trump said in an interview on
Revised: You can take it anywhere you want,” Trump said in an interview on

Original: Sunday with ABC’s George Stephanopoulos on “This Week. ”
Revised: Sunday with ABC’s George Stephanopoulos on “This Week. ”

Original: Washington(CNN)
Revised: Washington(CNN)

Original: Donald Trump said Sunday that Russian President Vladimir Putin won’t make a military move into Ukraine – even though Putin already has done just that, seizing the country’s Crimean Peninsula.
Revised: Donald Trump said Sunday that Russian President Vladimir Putin won’t make a military move into Ukraine – even though Putin already has done just that, seizing the country’s Crimean Peninsula.

Original: “He’s not going into Ukraine, OK, just so you under- stand.
Revised: “He’s not going into Ukraine, OK, just so you under- stand.

Original: He’s not going to go into Ukraine, all right?
Revised: He’s not going to go into Ukraine, all right?

Original: You can mark it down.
Revised: You can mark it down.

Original: You can put it down.
Revised: You can put it down.

Original: You can take it anywhere you want, ” Trump said in an interview on
Revised: You can take it anywhere you want, ” Trump said in an interview on

Original: Sunday with ABC’s George Stephanopoulos on “This Week. ”
Revised: Sunday with ABC’s George Stephanopoulos on “This Week. ”

Original: (CNN)
Revised: (CNN)

Original: After a slow start in October, flu season in the United States is gaining speed, particularly in the South.
Revised: After a slow start in October, flu season in the United States is gaining speed, particularly in the South.

Original: Flu activity, which has been increasing since the start of November, is now higher than usual for this time of year, according to a report published Thursday by the Centers for Disease Control and Prevention.
Revised: Flu activity, which has been increasing since the start of November, is now higher than usual for this time of year, according to a report published Thursday by the Centers for Disease Control and Prevention.

Original: Flu is a contagious, viral illness that causes mild to severe symptoms that, in rare cases, can lead to death.
Revised: Flu is a contagious, viral illness that causes mild to severe symptoms that, in rare cases, can lead to death.

Original: After a slow start in October, flu season in the United States is gaining speed, particularly in the South.
Revised: After a slow start in October, flu season in the United States is gaining speed, particularly in the South.

Original: Flu activity, which has been increasing since the start of November, is now higher than usual for this time of year, according to a report published Thursday by the Centers for Disease Control and Prevention.
Revised: Flu activity, which has been increasing since the start of November, is now higher than usual for this time of year, according to a report published Thursday by the Centers for Disease Control and Prevention.

Original: Flu is a contagious, viral illness that causes mild to severe symptoms that, in rare cases, can lead to death.
Revised: Flu is a contagious, viral illness that causes mild to severe symptoms that, in rare cases, can lead to death.

Original: Plans are being drawn up to build a £3.3m working replica of the boat that took Charles Darwin around the world at Milford Haven in Pembrokeshire.
Revised: Plans are being drawn up to build a £3.3m working replica of the boat that took Charles Darwin around the world at Milford Haven in Pembrokeshire.

Original: Fundraising for the project, which would mark the 200th anniversary of Darwin’s birth in 2009, is under way.
Revised: Fundraising for the project, which would mark the 200th anniversary of Darwin’s birth in 2009, is under way.

Original: The aim is to built a seaworthy vessel identical to the HMS Beagle on the outside, but with a modern interior.
Revised: The aim is to built a seaworthy vessel identical to the HMS Beagle on the outside, but with a modern interior.

Original: Plans are being drawn up to build a £33.3m working replica of the boat that took Charles Darwin around the world at Milford Haven in Pembrokeshire.
Revised: Plans are being drawn up to build a £33.3m working replica of the boat that took Charles Darwin around the world at Milford Haven in Pembrokeshire.

Original: Fundraising for the project, which would mark the 200th anniversary of Darwin’s birth in 2009, is under way.
Revised: Fundraising for the project, which would mark the 200th anniversary of Darwin’s birth in 2009, is under way.

Original: The aim is to built a seaworthy vessel identical to the HMS Beagle on the outside, but with a modern interior.
Revised: The aim is to built a seaworthy vessel identical to the HMS Beagle on the outside, but with a modern interior.

Original: A. L ARGE CLUSTERS IN C 
Revised: A. L ARGE CLUSTERS IN C

Original: When de-duplicating C we removed any clusters from the results that contained over 1000 texts, for RealNews or over 300 texts, for Google Patents.
Revised: When de-duplicating C we removed any clusters from the results that contained over 1000 texts, for RealNews, or over 300 texts, for Google Patents.

Original: This leads to the removal of 27 clusters for the bi-encoder over RealNews and 7 clusters for the bi-encoder over Google Patents.
Revised: This leads to the removal of 27 clusters for the bi-encoder over RealNews and 7 clusters for the bi-encoder over Google Patents.

Original: No clusters are removed under LSH.
Revised: No clusters are removed under LSH.

Original: These large clusters are not errors, as such, but tend to be clusters of texts that all follow some template.
Revised: These large clusters are not errors, as such, but tend to be clusters of texts that all follow some template.

Original: It seems possible that these would also cause problems for training large language models.
Revised: It seems possible that these would also cause problems for training large language models.

Original: However, there are also some cases where it is hoped that LLMs will learn to generate texts following such templates.
Revised: However, there are also some cases where it is hoped that LLMs will learn to generate texts following such templates.

Original: This appendix gives some examples of these templates.
Revised: This appendix gives some examples of these templates.

Original: 27% of this provider’s 380 patients filled at least one prescription for an antibiotic drug, compared to an average of 24%.
Revised: 27% of this provider’s 380 patients filled at least one prescription for an antibiotic drug, compared to an average of 24%.

Original: 18% of this provider’s 380 patients filled at least one prescription for an opioid, compared to an average of 14%.
Revised: 18% of this provider’s 380 patients filled at least one prescription for an opioid, compared to an average of 14%.

Original: 32 of this provider’s 74 patients who are 65 and older filled at least one prescription for an antipsychotic drug.
Revised: 32 of this provider’s 74 patients who are 65 and older filled at least one prescription for an antipsychotic drug.

Original: 0% of this provider’s 146 patients filled at least one prescription for an antibiotic drug, compared to an average of 1% 2% of this provider’s 532 patients who are 65 and older filled at least one prescription for an antipsychotic drug, compared to an average of 3%.
Revised: 0% of this provider’s 146 patients filled at least one prescription for an antibiotic drug, compared to an average of 1% 2% of this provider’s 532 patients who are 65 and older filled at least one prescription for an antipsychotic drug, compared to an average of 3%.

Original: 44% of this provider’s 618 patients filled at least one prescription for an antibiotic drug, compared to an average of 29% Select up to 3 trims below to compare some key specs and options for the 2010 Mercury Milan Hybrid.
Revised: 44% of this provider’s 618 patients filled at least one prescription for an antibiotic drug, compared to an average of 29% Select up to 3 trims below to compare some key specs and options for the 2010 Mercury Milan Hybrid.

Original: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific Milan Hybrid trim.
Revised: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific Milan Hybrid trim.

Original: Select up to 3 trims below to compare some key specs and options for the 2010 BMW X6.
Revised: Select up to 3 trims below to compare some key specs and options for the 2010 BMW X6.

Original: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific X6 trim.
Revised: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific X6 trim.

Original: Select up to 3 trims below to compare some key specs and options for the 2012 Buick Enclave.
Revised: Select up to 3 trims below to compare some key specs and options for the 2012 Buick Enclave.

Original: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific Enclave trim.
Revised: For full details such as dimensions, cargo capacity, suspension, colors, and brakes, click on a specific Enclave trim.

Original: 64, of Las Vegas, died 
Revised: 64, of Las Vegas, died in Las

Original: [Table]
Revised: [Table]

Original: 2003-09-10 First worldwide family litigation filed litigation Critical https://patents.darts-ip.
Revised: 2003-09-10 First worldwide family litigation filed litigation Critical https://patents.darts-ip.

Original: com/?family=20401150&utm_source=
Revised: com/?family=20401150&utm_source=

Original: google_patent&utm_medium=
Revised: google_patent&utm_medium=

Original: platform_link& utm_campaign=public_patent_search&patent=US20060293642(A1) “Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Revised: platform_link& utm_campaign=public_patent_search&patent=US20060293642(A1) “Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.

Original: The present invention relates to wetting apparatus for wetting or hydrophilic urinary catheters comprising a wetting receptacle which defines a wetting fluid receiving area which is adapted to receive a hydrophilic urinary catheter 2005-04-21 First worldwide family litigation filed litigation Critical https://patents.darts-ip.
Revised: The present invention relates to wetting apparatus for wetting or hydrophilic urinary catheters comprising a wetting receptacle which defines a wetting fluid receiving area which is adapted to receive a hydrophilic urinary catheter 2005-04-21 First worldwide family litigation filed litigation Critical https://patents.darts-ip.

Original: com/?family=21928393&utm_source=
Revised: com/?family=21928393&utm_source=

Original: google_patent&utm_medium=
Revised: google_patent&utm_medium=

Original: platform_link& utm_campaign=public_patent_search&patent=EP0719564(B1) “Global patent litigation dataset´’ by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Revised: platform_link& utm_campaign=public_patent_search&patent=EP0719564(B1) “Global patent litigation dataset´’ by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.

Original: This invention relates generally to medical appliances; and more particularly to a device for inserting a cannula – such as an intravenous cannula – into a patient’s body.
Revised: This invention relates generally to medical appliances; and more particularly to a device for inserting a cannula – such as an intravenous cannula – into a patient’s body.

Original: As is well known, there are myriad very important medical uses 2003-01-06 First worldwide family litigation filed litigation Critical https://patents.darts-ip.
Revised: As is well known, there are myriad very important medical uses 2003-01-06 First worldwide family litigation filed litigation Critical https://patents.darts-ip.

Original: com/?family=40090178&utm_source=
Revised: com/?family=40090178&utm_source=

Original: google_patent&utm_medium=
Revised: google_patent&utm_medium=

Original: platform_link& utm_campaign=public_patent_search&patent=US6554611(B2) “Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Revised: platform_link& utm_campaign=public_patent_search&patent=US6554611(B2) “Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.

Original: A system for repositioning teeth comprises a plurality of individual appliances.
Revised: A system for repositioning teeth comprises a plurality of individual appliances.

Original: The appliances are configured to be placed successively on the patient’s teeth and to incrementally reposition the teeth from an initial tooth arrangement,
Revised: The appliances are configured to be placed successively on the patient’s teeth and to incrementally reposition the teeth from an initial tooth arrangement,