LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection
Authors: name: Mervat Abassy; name: Kareem Elozeiri; name: Alexander Aziz; name: Minh Ngoc Ta; name: Raj Vardhan Tomar; name: Bimarsha Adhikari; name: Saad El Dine Ahmed; name: Yuxia Wang; name: Osama Mohammed Afzal; name: Zhuohan Xie; name: Jonibek Mansurov; name: Ekaterina Artemova; name: Vladislav Mikhailov; name: Rui Xing; name: Jiahui Geng; name: Hasan Iqbal; name: Zain Muhammad Mujahid; name: Tarek Mahmoud; name: Akim Tsvigun; name: Alham Fikri Aji; name: Artem Shelmanov; name: Nizar Habash; name: Iryna Gurevych; name: Preslav Nakov
Published: 2024-08-08 07:43:17

Abstract: The widespread accessibility of large language models (LLMs) to the general
public has significantly amplified the dissemination of machine-generated texts
(MGTs). Advancements in prompt manipulation have exacerbated the difficulty in
discerning the origin of a text (human-authored vs machinegenerated). This
raises concerns regarding the potential misuse of MGTs, particularly within
educational and academic domains. In this paper, we present
LLM-DetectAIve -- a system designed for fine-grained MGT detection.
It is able to classify texts into four categories: human-written,
machine-generated, machine-written machine-humanized, and human-written
machine-polished. Contrary to previous MGT detectors that perform binary
classification, introducing two additional categories in LLM-DetectiAIve offers
insights into the varying degrees of LLM intervention during the text creation.
This might be useful in some domains like education, where any LLM intervention
is usually prohibited. Experiments show that LLM-DetectAIve can effectively
identify the authorship of textual content, proving its usefulness in enhancing
integrity in education, academia, and other domains. LLM-DetectAIve is publicly
accessible at https://huggingface.co/spaces/raj-tomar001/MGT-New. The video
describing our system is available at https://youtu.be/E8eT_bE7k8c.