cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.5281/zenodo.10013754
title: MULTITuDEv3

description: MULTITuDEv3 is a dataset for multilingual machine-generated text detection benchmark, originally described in the EMNLP 2023 conference paper. It consisted of 7992 human-written news texts in 11 languages subsampled from MassiveSumm, accompanied by 66089 texts generated by 8 large language models (by using headlines of news articles) (see MULTITuDEv1). The creation process and scripts for replication/extension are located in a GitHub repository. The dataset has been further extended in MULTITuDEv2 by obfuscated texts using 10 authorship obfuscation methods, described in the EMNL 2024 Findings conference paper. This version covers 21 languages (instead of original 11) with mostly equal coverage in the training set and has been introduced in ACL 2025 conference paper for out-of-domain evaluation of detectors trained on social-media texts.

If you use this dataset in any publication, project, tool or in any other form, please, cite the paper.

Fields

The dataset has the following fields:



'text' - a text sample,

'label' - 0 for human-written text, 1 for machine-generated text,

'multi_label' - a string representing a large language model that generated the text or the string "human" representing a human-written text,

'split' - a string identifying train or test split of the dataset for the purpose of training and evaluation respectively,

'language' - the ISO 639-1 language code identifying the language of the given text,

'length' - word count of the given text,

'source' - a string identifying the source dataset / news medium of the given text


Statistics (the number of samples)

Splits:



train - 156240

test - 50090

train+test - 206330


Binary labels:



0 - 25945

1 - 180385


Multiclass labels:



human -                            25945

aya-101 -                          25948

Mistral-7B-Instruct-v0.2 - 25937

gpt-3.5-turbo-0125 -        25935

v5-Eagle-7B-HF -              25892

vicuna-13b -                     25876

opt-iml-max-30b -           25568

Llama-2-70b-chat-hf -     25229


Languages:








Language
train
test




Arabic
7975
2392


Bulgarian
7954
2386


Catalan
2894
2389


Chinese
7926
2383


Croatian
7951
2384


Czech
7962
2389


Dutch
7958
2386


English
7954
2384


German
7951
2388


Greek
7944
2384


Hungarian
7964
2385


Irish
2333
2381


Polish
7946
2383


Portuguese
7956
2388


Romanian
7949
2386


Russian
7945
2382


Scottish Gaelic
7899
2377


Slovak
7946
2385


Slovenian
7947
2386


Spanish
7947
2387


Ukrainian
7939
2385
DOI: 10.5281/zenodo.10013755
title: MULTITuDE

description: MULTITuDE is a dataset for multilingual machine-generated text detection benchmark, described in the EMNLP 2023 conference paper. It consists of 7992 human-written news texts in 11 languages subsampled from MassiveSumm, accompanied by 66089 texts generated by 8 large language models (by using headlines of news articles). The creation process and scripts for replication/extension are located in a GitHub repository.
If you use this dataset in any publication, project, tool or in any other form, please, cite the paper.
Fields
The dataset has the following fields:

'text' - a text sample,
'label' - 0 for human-written text, 1 for machine-generated text,
'multi_label' - a string representing a large language model that generated the text or the string "human" representing a human-written text,
'split' - a string identifying train or test split of the dataset for the purpose of training and evaluation respectively,
'language' - the ISO 639-1 language code identifying the language of the given text,
'length' - word count of the given text,
'source' - a string identifying the source dataset / news medium of the given text.
Statistics (the number of samples)
Splits:

train - 44786
test - 29295
Binary labels:

0 - 7992
1 - 66089
Multiclass labels:

gpt-3.5-turbo -       8300
gpt-4 -                    8300
text-davinci-003 -   8297
alpaca-lora-30b -   8290
vicuna-13b -          8287
opt-66b -                8229
llama-65b -            8229
opt-iml-max-1.3b - 8157
human -                 7992
Languages:

English (en) - 29460 (train + test)
Spanish (es) - 11586 (train + test)
Russian (ru) - 11578 (train + test)
Dutch (nl) - 2695 (test)
Catalan (ca) - 2691 (test)
Czech (cs) - 2689 (test)
German (de) - 2685 (test)
Chinese (zh) - 2683 (test)
Portuguese (pt) - 2673 (test)
Arabic (ar) - 2673 (test)
Ukrainian (uk) - 2668 (test)
DOI: 10.5281/zenodo.13846588
title: MULTITuDEv2

description: MULTITuDEv2 is a dataset for multilingual machine-generated text detection benchmark, described in the EMNLP 2023 conference paper. It consists of 7992 human-written news texts in 11 languages subsampled from MassiveSumm, accompanied by 66089 texts generated by 8 large language models (by using headlines of news articles). The creation process and scripts for replication/extension are located in a GitHub repository. The dataset has been further extended in v2 by obfuscated texts using 10 authorship obfuscation methods, described in the EMNL 2024 Findings conference paper.

If you use this dataset in any publication, project, tool or in any other form, please, cite the paper.

Files

The v2 of the dataset consists of multiple files. 'multitude.csv' contains original v1 of the dataset (i.e., without the field 'generated'). The other files contains also the 'generated' field (as described below) and are compressed by GZIP. The file 'multitude_obfuscated_original.csv.gz' contains copies of the 'text' field in the 'generated' field to be compatible with files with the obfuscated texts (used as such in the experiments).

Fields

The dataset has the following fields:



'text' - an original (unobfuscated) text sample,

'label' - 0 for human-written text, 1 for machine-generated text,

'multi_label' - a string representing a large language model that generated the text or the string "human" representing a human-written text,

'split' - a string identifying train or test split of the dataset for the purpose of training and evaluation respectively,

'language' - the ISO 639-1 language code identifying the language of the given text,

'length' - word count of the given text,

'source' - a string identifying the source dataset / news medium of the given text,

'generated' - an obfuscated text sample (i.e., transformed from original text by the obfuscator indicated by the corresponding filename)


Note: some obfuscated text in the 'generated' field are the same as in the 'text' field, indicating failure of the obfuscator to modify the text. Human-written obfuscated texts are also included; however, labels of their originals might be no longer relevant for them (i.e., human-written text obfuscated by a machine could be considered as machine-generated as well); thus, consider this in your research.

Statistics (the number of samples)

Splits:



train - 44786

test - 29295


Binary labels:



0 - 7992

1 - 66089


Multiclass labels:



gpt-3.5-turbo -       8300

gpt-4 -                    8300

text-davinci-003 -   8297

alpaca-lora-30b -   8290

vicuna-13b -          8287

opt-66b -                8229

llama-65b -            8229

opt-iml-max-1.3b - 8157

human -                 7992


Languages:



English (en) - 29460 (train + test)

Spanish (es) - 11586 (train + test)

Russian (ru) - 11578 (train + test)

Dutch (nl) - 2695 (test)

Catalan (ca) - 2691 (test)

Czech (cs) - 2689 (test)

German (de) - 2685 (test)

Chinese (zh) - 2683 (test)

Portuguese (pt) - 2673 (test)

Arabic (ar) - 2673 (test)

Ukrainian (uk) - 2668 (test)
DOI: 10.5281/zenodo.15519413
title: MULTITuDEv3

description: MULTITuDEv3 is a dataset for multilingual machine-generated text detection benchmark, originally described in the EMNLP 2023 conference paper. It consisted of 7992 human-written news texts in 11 languages subsampled from MassiveSumm, accompanied by 66089 texts generated by 8 large language models (by using headlines of news articles) (see MULTITuDEv1). The creation process and scripts for replication/extension are located in a GitHub repository. The dataset has been further extended in MULTITuDEv2 by obfuscated texts using 10 authorship obfuscation methods, described in the EMNL 2024 Findings conference paper. This version covers 21 languages (instead of original 11) with mostly equal coverage in the training set and has been introduced in ACL 2025 conference paper for out-of-domain evaluation of detectors trained on social-media texts.

If you use this dataset in any publication, project, tool or in any other form, please, cite the paper.

Fields

The dataset has the following fields:



'text' - a text sample,

'label' - 0 for human-written text, 1 for machine-generated text,

'multi_label' - a string representing a large language model that generated the text or the string "human" representing a human-written text,

'split' - a string identifying train or test split of the dataset for the purpose of training and evaluation respectively,

'language' - the ISO 639-1 language code identifying the language of the given text,

'length' - word count of the given text,

'source' - a string identifying the source dataset / news medium of the given text


Statistics (the number of samples)

Splits:



train - 156240

test - 50090

train+test - 206330


Binary labels:



0 - 25945

1 - 180385


Multiclass labels:



human -                            25945

aya-101 -                          25948

Mistral-7B-Instruct-v0.2 - 25937

gpt-3.5-turbo-0125 -        25935

v5-Eagle-7B-HF -              25892

vicuna-13b -                     25876

opt-iml-max-30b -           25568

Llama-2-70b-chat-hf -     25229


Languages:








Language
train
test




Arabic
7975
2392


Bulgarian
7954
2386


Catalan
2894
2389


Chinese
7926
2383


Croatian
7951
2384


Czech
7962
2389


Dutch
7958
2386


English
7954
2384


German
7951
2388


Greek
7944
2384


Hungarian
7964
2385


Irish
2333
2381


Polish
7946
2383


Portuguese
7956
2388


Romanian
7949
2386


Russian
7945
2382


Scottish Gaelic
7899
2377


Slovak
7946
2385


Slovenian
7947
2386


Spanish
7947
2387


Ukrainian
7939
2385
DOI: 10.15468/dl.h4mcmj
title: Occurrence Download

description: A dataset containing 17558 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Physalia physalis (Linnaeus, 1758)"
 ]
}

 The dataset includes 17558 records from 120 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0001828-250525065834625/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.5pcftm
title: Occurrence Download

description: A dataset containing 35827609 species occurrences available in GBIF matching the query:
(Query is too complex. Can be viewed on the landing page)

 The dataset includes 35827609 records from 4307 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0001666-250525065834625/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.4nauf4
title: Occurrence Download

description: A dataset containing 336 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is one of (Scaphopoda)",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "Year is greater than or equal to 1980",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 },
 "Geometry POLYGON((90 -30,120 -30,120 0,90 0,90 -30))"
 ]
}

 The dataset includes 336 records from 10 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0012846-251009101135966/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.25549/uschist-c104-286768
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-286429
title: USC Black Alumni reception for Steven Sample's inauguration, 1991

description: 41 photographs documenting the University of Southern California Black Alumni reception on behalf of Steven Sample during his inauguration as president of USC, 1991 September 6.
DOI: 10.25549/uschist-c104-286434
title: USC Black Alumni reception for Steven Sample's inauguration, 1991

description: 41 photographs documenting the University of Southern California Black Alumni reception on behalf of Steven Sample during his inauguration as president of USC, 1991 September 6.
DOI: 10.25549/uschist-c104-286437
title: USC Black Alumni reception for Steven Sample's inauguration, 1991

description: 41 photographs documenting the University of Southern California Black Alumni reception on behalf of Steven Sample during his inauguration as president of USC, 1991 September 6.
DOI: 10.25549/uschist-c104-286441
title: USC Black Alumni reception for Steven Sample's inauguration, 1991

description: 41 photographs documenting the University of Southern California Black Alumni reception on behalf of Steven Sample during his inauguration as president of USC, 1991 September 6.
DOI: 10.25549/uschist-c104-286442
title: USC Black Alumni reception for Steven Sample's inauguration, 1991

description: 41 photographs documenting the University of Southern California Black Alumni reception on behalf of Steven Sample during his inauguration as president of USC, 1991 September 6.
DOI: 10.15468/dl.gvdnxz
title: Occurrence Download

description: A dataset containing 78 species occurrences available in GBIF matching the query:
{
 "and" : [
 "Country is Côte d’Ivoire",
 "TaxonKey is Coffea canephora"
 ]
}

 The dataset includes 78 records from 16 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0030244-260208012135463/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.25549/uschist-c104-286738
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-286750
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-287566
title: Football game(s), USC, 1907 & 1997

description: 10 photographs of a football game(s), Los Angeles Memorial Colliseum, 3911 South Figueroa Street, University of Southern California, 1997. Pictured are the fan-filled seats, the Trojan mascot on the white horse, Traveller, the football players and coach. Also included is a photograph of the 1907 USC football team.
DOI: 10.25549/uschist-c104-287567
title: Football game(s), USC, 1907 & 1997

description: 10 photographs of a football game(s), Los Angeles Memorial Colliseum, 3911 South Figueroa Street, University of Southern California, 1997. Pictured are the fan-filled seats, the Trojan mascot on the white horse, Traveller, the football players and coach. Also included is a photograph of the 1907 USC football team.
DOI: 10.25549/uschist-c104-287570
title: Football game(s), USC, 1907 & 1997

description: 10 photographs of a football game(s), Los Angeles Memorial Colliseum, 3911 South Figueroa Street, University of Southern California, 1997. Pictured are the fan-filled seats, the Trojan mascot on the white horse, Traveller, the football players and coach. Also included is a photograph of the 1907 USC football team.
DOI: 10.25549/uschist-c104-284885
title: Students outside, USC, 1997-2006

description: 42 photographs of students outside on the campus of the University of Southern California, 1997, 2004, & 2006. Students are shown talking, walking, studying, bicyling, practicing, posing, socializing, acting, and working primarily on campus. Credit: photos #8/47, #8/66, #8/67, #8/118, #8/157, #8/158, #8/163, #8/172, #8/182, #8/190, #8/203, #8/207 by Philip Channing.
DOI: 10.25549/uschist-c104-286119
title: Von Kleinsmid Center, USC, 1997-2008

description: 25 photographs of the Von Kleinsmid Center for International and Public Affairs, 3518 Trousdale Parkway, University of Southern California, 1997, 2004-2006 & 2008. Included are images of the tower, the atrium, the international flags, and views from across the reflecting pool in front of Leavey Library. Credits: photos #8/24, #8/62, #8/70, #8/138, #8/195, #8/196, #8/197, #8/198, #8/199, #8/200 by Philip Channing; photos #7/18, #7/22, #7/23 by Dietmar Quistorf; #62/110 uncredited.
DOI: 10.25549/uschist-c104-284195
title: Commencement, USC, 1994-2004

description: 9 photographs of commencement at the University of Southern California, 1997, 2002, & 2004. Included are the Alumni Park walkway between Bovard and Doheny (1997 May & 2002 October 29 -- two different color corrections), happy graduates (1997 May) (2004 May 14 photos by Philip Channing), stacks of diplomas (1997 May), and George Lucas with Stephen Spielberg in academic regalia (1994 May 6).
DOI: 10.25549/uschist-c104-284698
title: USC Trojan-themed window pane, 2004

description: 2 photographs of a window pane with a University of Southern California Trojan theme, 2004.
DOI: 10.25549/uschist-c104-286773
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-286775
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-285291
title: Youth Triumphant fountain, USC, 1997-2008

description: 20 photographs of the Youth Triumphant fountain (Prentiss Memorial Fountain), on the walkway in Alumni Park between Bovard and Doheny, University of Southern California, 1997, 2004, 2006, & 2008. Credits: photos #8/6, #8/8, #8/9, #8/20, #8/21, #8/26, #8/141, #8/142, #8/159, #8/160, #8/166, #8/167 by Philip Channing; photos #7/1, #7/2, #7/3, #7/4, #7/25, #7/26 by Deitmar Quistorf.
DOI: 10.25549/uschist-ouc12567750
title: Bovard Administration Building, USC, 1950s-2008

description: 57 photographs of George Finley Bovard Administration Building, University Avenue and later 3551 Trousdale Parkway, University of Southern California, 1950s, 1997, 2002, 2004, 2005, 2006, & 2008. Images include busy pedestrian and automobile traffic in front of the building in the 1950s, students posing and talking near the building, iconic and striking images of the main tower at day and at night, a 360-degree view, the adjacent student union building and the tower of Waite Phillips Hall, and the skyscrapers of downtown Los Angeles in the background. Credits: #3/18 copyright Accusoft; #7/5, #7/6, #7/10, #7/11, #7/12, #7/16, #7/24, #7/27 by Dietmar Quistorf; #8/5, #8/7, #8/10, #8/11, #8/12, #8/13, #8/50, #8/120, #8/127, #8/128, #8/129, #8/135; #8/136, #8/137, #8/139, #8/140, #8/143, #8/144, #8/146, #8/147, #8/171, #8/178, #8/191, #9/192, #62/66 by Philip Channing; #62/109, #62/111 uncredited.
DOI: 10.25549/uschist-c104-285970
title: Franklin fountain, USC, 2004-2008

description: 4 photographs of the fountain in Carolyn Criag Franklin Library Garden Courtyard, on Hellman Way adjacent to the Doheny Memorial Library, University of Southern California, 2004 (photos by Philip Channing), 2006 (photo by Philip Channing), & 2008 (photo by Dietmar Quistorf). The Von Kleinsmid Center is visible in the background of one image (2008 February 8) and Leavey Library is in the background of another (2006 February 14). Two other close-ups face north (2004 May 11).
DOI: 10.25549/uschist-c104-286769
title: Students and professors in learning interior environments, USC, 1997-2006

description: 69 photographs of students and professors inside various buildings at the University of Southern California, 1997, 2002 August 29, 2004 June 21, 2005 October 3, 2006 March 1, & 2006 April 6. Students are shown studying, talking and learning in social locations, hallways, libraries, computer labs, lecture halls, classrooms, laboratories, and dormatories. Credit: photo #8/173 by Philip Channing.
DOI: 10.25549/uschist-c104-286369
title: Health Sciences campus, USC, 1997-2004

description: 30 photographs of exterior and interior images of the University of Southern California Health Sciences campus, 1997 & 2004 April 6. Included are images of the Zilkha Neurogenetic Institute, Norris Medical Library, John Stauffer Pharmaceutical Sciences Center, USC/Norris Comprehensive Cancer Center and Hospital, Los Angeles County / USC Medical Center, USC Healthcare Consultation Center, Elaine Stevely Hoffman Medical Research Center, as well as images of students, patients, doctors, and other health care workers.
DOI: 10.15468/dl.javgaq
title: Occurrence Download

description: A dataset containing 14336 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Campephilus pollens",
 "Year is greater than or equal to 2000",
 "Year is less than or equal to 2026",
 "HasCoordinate is true"
 ]
}

 The dataset includes 14336 records from 57 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0030245-260208012135463/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.25549/uschist-c104-284190
title: Commencement, USC, 1994-2004

description: 9 photographs of commencement at the University of Southern California, 1997, 2002, & 2004. Included are the Alumni Park walkway between Bovard and Doheny (1997 May & 2002 October 29 -- two different color corrections), happy graduates (1997 May) (2004 May 14 photos by Philip Channing), stacks of diplomas (1997 May), and George Lucas with Stephen Spielberg in academic regalia (1994 May 6).
DOI: 10.25549/uschist-c104-284134
title: Gwynn Wilson Student Union, USC, 1997-2006

description: 23 photographs of Gwynn Wilson Student Union, 3601 Trousdale Parkway (previously University Avenue), University of Southern California, 1950s, 1997, 2002 October 28, 2004 May 19, 2004 June 21, 2006 June 14, 2006 February 14, 2006 March 2, & 2006 April 6. Included are exterior images (architectural details, students around the building, adjacent buildings) and interior images (eating places). Credit: photo #8/4, #8/126, #8/202 by Philip Channing; #62/112 uncredited.