SlowGuess/NAACL_2021_OCR huggingface dataset:
We find that topics relating to science, sports, places in specific countries, and entertainment transfer well. Perhaps this is due to shared vocabulary for these subjects, as these all contain either scientific terms or proper nouns which are orthographically identical cross-lingually. Or perhaps these subjects are frequently seen during pretraining, thus enabling more isomorphic representations to form around such subjects.
Figure 4: English vs. French topic assignments for aligned documents.
Figure 5: English vs. German topic assignments for aligned documents.
Figure 6: English vs. Portuguese topic assignments for aligned documents.
Figure 7: English vs. Dutch topic assignments for aligned documents.
Figure 8: Counts of the most probable topics for each English document in the aligned test set, according to an XLM-R based CTM with non-fine-tuned embeddings (left) and embeddings fine-tuned on NLI (right).
Lang	Sample Document	Topic
en	Passiflora, known also as the passion flowers...	9: cultivated, flower, tall, stems, perennial
fr	Passiflora est un genre de plantes, les passiflores...	9: cultivated, flower, tall, stems, perennial
pt	Passiflora é um@générotobânicode.cerca...	9: cultivated, flower, tall, stems, perennial
de	Die art enreiche Pflanzengattung der Passionsblumen...	7: gene, organisms, cell, biology, dna
nl	Het geslacht passiebloem (Passiflora) is een geslacht...	9: cultivated, flower, tall, stems, perennial
en	Belgium competed at the 1952 Winter Olympics...	91: target, boxing, beijing, loser, summer
fr	...la Belgique aux Jeux olympiques d'hiver de 1952...	91: target, boxing, beijing, loser, summer
pt	A Bélgica competiu nos Jogos Olímpicos de Inverno de 1952...	91: target, boxing, beijing, loser, summer
de	Belgien nahm an den VI. Olympischen Winterspielen 1952...	91: target, boxing, beijing, loser, summer
nl	Tijdens de Olympische Winterspelen van 1952...	91: target, boxing, beijing, loser, summer
en	James Maritato is an American professional wrestler...	41: wrestler, ring, wwe, heavyweight, professional
fr	...James Maritato...est un ancien catcheur américain...	41: wrestler, ring, wwe, heavyweight, professional
pt	James Maritato é um lutador de wrestling professionai italo-americo...	41: wrestler, ring, wwe, heavyweight, professional
de	James Maritato...ist ein US-amerikanischer Wrestler...	41: wrestler, ring, wwe, heavyweight, professional
nl	James Maritato is een Amerikaans professioneel worstelaar...	41: wrestler, ring, wwe, heavyweight, professional
en	Nemochovice is a village...in the South Moravian Region of the Czech Republic...	22: czech, prague, bohemian, republic, slovakia
fr	Nemochovice est un village...dans la Moravie-du-Sud en République chéque...	22: czech, prague, bohemian, republic, slovakia
pt	Nemochovice é uma comuna hecka localizada na região de Moravia do Sul...	22: czech, prague, bohemian, republic, slovakia
de	Nemochowitz ist eine Gemeinde in Tschechien...	22: czech, prague, bohemian, republic, slovakia
nl	Nemochovice is een Tsjechische gemeente in de regio Zuid-Moravië...	22: czech, prague, bohemian, republic, slovakia
en	"Set Fire to the Rain" is a song by British singer-songwriter Adele...	83: certified, single, billboard, critics, charts
fr	Set Fire to the Rain est une chanson de la chanteuse Britannique Adele...	83: certified, single, billboard, critics, charts
pt	"Set Fire to the Rain" é uma cançao da cantora e compositora britânica Adele...	83: certified, single, billboard, critics, charts
de	Set Fire to the Rain ist ein Lied der britschen Sängerin Adele...	83: certified, single, billboard, critics, charts
nl	Set Fire to the Rain is de twede single van Adele's album 21...	83: certified, single, billboard, critics, charts
Table 4: Sample documents for the topics with high cross-lingual precision.