DOI: 10.5281/zenodo.17341582
title: MultiClinSum Dataset: Summarization of Clinical Case Reports in English, Spanish, French and Portuguese

description: MultiClinSum Shared Task Dataset

MultiClinSum is a shared task about the automatic summarization of clinical case reports in English, Spanish, French and Portuguese held as part of the BioASQ workshop at CLEF 2025. The task relies on a corpus of manually selected full clinical case reports and their corresponding clinical case report summaries derived from case report publications written in the previously mentioned languages. In addition, participants are allowed to use any other data source available online as long as they report it.

This repository includes the available datasets for the multilingual clinical summarization task. Each dataset contains pairs of full-text documents and their corresponding summaries.



multiclinsum_gs_train_en: Gold-standard training dataset in English, containing 592 full-text and summary pairs.

multiclinsum_gs_train_es: Gold-standard training dataset in Spanish, containing 592 full-text and summary pairs.

multiclinsum_gs_train_fr: Gold-standard training dataset in French, containing 592 full-text and summary pairs.

multiclinsum_gs_train_pt: Gold-standard training dataset in Portuguese, containing 592 full-text and summary pairs.

multiclinsum_large-scale_train_en: Large scale training dataset in English, containing 25.902 full-text and summary pairs.

multiclinsum_large-scale_train_es: Large scale training dataset in Spanish, containing 25.902 full-text and summary pairs.

multiclinsum_large-scale_train_fr: Large scale training dataset in French, containing 25.902 full-text and summary pairs.

multiclinsum_large-scale_train_pt: Large scale training dataset in Portuguese, containing 25.902 full-text and summary pairs.

multiclinsum_test_en: English test dataset, containing 3.396 full-text and summary pairs.

multiclinsum_test_es: Spanish test dataset, containing 3.406 full-text and summary pairs.

multiclinsum_test_fr: French test dataset, containing 3.469 full-text and summary pairs.

multiclinsum_test_pt: Portuguese test dataset, containing 3.442 full-text and summary pairs.


For each dataset, full-texts and summaries are organised in separate folders containing .txt files encoded in UTF-8. For a given language, files have nearly identical filenames, with summaries marked by the _sum suffix.

 

Please cite if you use this dataset:

Rodríguez-Ortega M, Rodríguez-Lopez E, Lima-López S, Escolano C, Melero M, Pratesi L, Vigil-Giménez L, Fernandez L, Farré-Maduell E, Krallinger M. Overview of MultiClinSum task at BioASQ 2025: evaluation of clinical case summarization strategies for multiple languages: data, evaluation, resources and results. InCLEF 2025.





 

@inproceedings{rodriguez2025overview,title={Overview of MultiClinSum task at BioASQ 2025: evaluation of clinical case summarization strategies for multiple languages: data, evaluation, resources and results},author={Rodr{\'\i}guez-Ortega, Miguel and Rodr{\'\i}guez-Lopez, Eduardo and Lima-L{\'o}pez, Salvador and Escolano, Carlos and Melero, Maite and Pratesi, Lorenzo and Vigil-Gim{\'e}nez, Laura and Fernandez, Letic{\'\i}a and Farr{\'e}-Maduell, Eulàlia and Krallinger, Martin},booktitle={CLEF},year={2025}}



Resources:

- MultiClinSum website

- BioASQ website

License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Contact

If you have any questions or suggestions, please contact us at:



Miguel Rodríguez Ortega (<miguel [dot] rod [dot] bsc [at] gmail [dot] com>)

Eduard Rodríguez López (<edu4bsc [at] gmail [dot] com>)

Salvador Lima-López (<salvador [dot] limalopez [at] gmail [dot] com>)

Martin Krallinger (<krallinger [dot] martin [at] gmail [dot] com>)


Additional resources and corpora

If you are interested in MultiClinSum, you might want to check out these corpora and resources:



DisTEMIST (Corpus of disease mentions and normalization to SNOMED CT)

MedProcNER (Corpus of clinical procedure mentions and normalization to SNOMED CT)

SympTEMIST (Corpus of clinical findings and normalization to SNOMED CT)

DrugTEMIST (Corpus of medication mentions)

CardioCCC (Corpus of diseases and medication mentions in cardiology texts)

PharmaCoNER (Corpus of medications, drugs, chemical substances, genes, proteins and vaccine mentions and normalization)

MEDDOPROF (Corpus of mentions of professions, occupations and working status and normalization)

MEDDOPLACE (Corpus of mentions of place-related entity mentions, including departments, nationalities or patient movements etc.. and normalization)

MEDDOCAN (Corpus of mentions of Personal Health Identifiers (PHI))

CANTEMIST (Corpus of cancer tumor morphology mentions and normalization)

CodiESP (Corpus of clinical case reportes with assigned clinical codes from ICD10, Spanish version)

LivingNER (Corpus of mentions of species, including human/family members, pathogens, food, etc.. and normalization to NCBI Taxonomy)

SPACCC-POS (Corpus of clinical case reports in Spanish annotated with POS-tags)

SPACCC-TOKEN (Corpus of clinical case reports in Spanish annotated with token-tags (word mention boundaries))

SPACCC-SPLIT (Corpus of clinical case reports in Spanish annotated with sentence boundary-tags)

MESINESP-2 (Corpus of manually indexed records with DeCS /MeSH terms comprising scientific literature abstracts, clinical trials, and patent abstracts)