DOI: 10.57760/sciencedb.29741
title: MDD-TD: Large Language Model Text Source and Content Authenticity Detection Dataset
title: MDD-TD：大语言模型文本来源及内容真伪检测数据集

description: With the rapid advancement of large language models (LLMs), detecting text generated by LLMs has garnered increasing attention. To address the scarcity of text detection datasets, this study proposes and constructs a high-quality, multi-domain text detection dataset, MDD-TD (Multi-Domain Text Detection Dataset), based on two detection tasks: source detection and content authenticity verification. The dataset sources encompass three dimensions: translation-optimized open-source data, web-crawled open-source data, and prompt-augmented synthetic data. Translation corpora were derived from the SimpleAI/HC3 dataset by selecting high-quality responses for translation and refinement. Web-crawled open-source corpora were obtained by scraping and curating data from Weibo and Douban platforms. Synthetic data was generated using rule-driven methods, leveraging existing translation and web-sourced data through various prompt strategies. For quality control, the PPL method was first applied to calculate perplexity distributions using language models, removing texts with abnormal perplexity. Semantic similarity-based deduplication maintained diversity, supplemented by manual review to ensure data authenticity and reliability. Ultimately, 30,000 high-quality data points were selected and stored in JSON format, containing text, source, and authenticity labels, and categorized into three core detection tasks: Q&A, comments, and news texts. The MDD-TD dataset holds significant value for text source tracing and content authenticity verification, supporting research and applications in large-model tasks such as generative detection and misinformation governance, thereby enhancing model credibility and security.
description: With the rapid advancement of large language models (LLMs), detecting text generated by LLMs has garnered increasing attention. To address the scarcity of text detection datasets, this study proposes and constructs a high-quality, multi-domain text detection dataset, MDD-TD (Multi-Domain Text Detection Dataset), based on two detection tasks: source detection and content authenticity verification. The dataset sources encompass three dimensions: translation-optimized open-source data, web-crawled open-source data, and prompt-augmented synthetic data. Translation corpora were derived from the SimpleAI/HC3 dataset by selecting high-quality responses for translation and refinement. Web-crawled open-source corpora were obtained by scraping and curating data from Weibo and Douban platforms. Synthetic data was generated using rule-driven methods, leveraging existing translation and web-sourced data through various prompt strategies. For quality control, the PPL method was first applied to calculate perplexity distributions using language models, removing texts with abnormal perplexity. Semantic similarity-based deduplication maintained diversity, supplemented by manual review to ensure data authenticity and reliability. Ultimately, 30,000 high-quality data points were selected and stored in JSON format, containing text, source, and authenticity labels, and categorized into three core detection tasks: Q&A, comments, and news texts. The MDD-TD dataset holds significant value for text source tracing and content authenticity verification, supporting research and applications in large-model tasks such as generative detection and misinformation governance, thereby enhancing model credibility and security.