Robust and Fine-Grained Detection of AI Generated Texts
Authors: name: Ram Mohan Rao Kadiyala, name: Siddartha Pullakhandam, name: Kanwal Mehreen, name: Drishti Sharma, name: Siddhant Gupta, name: Jebish Purbey, name: Ashay Srivastava, name: Subhasya TippaReddy, name: Arvind Reddy Bobbili, name: Suraj Telugara Chandrashekhar, name: Modabbir Adeeb, name: Srinadh Vura, name: Hamza Farooq

An ideal detection system for machine generated content is supposed to work
well on any generator as many more advanced LLMs come into existence day by
day. Existing systems often struggle with accurately identifying AI-generated
content over shorter texts. Further, not all texts might be entirely authored
by a human or LLM, hence we focused more over partial cases i.e human-LLM
co-authored texts. Our paper introduces a set of models built for the task of
token classification which are trained on an extensive collection of
human-machine co-authored texts, which performed well over texts of unseen
domains, unseen generators, texts by non-native speakers and those with
adversarial inputs. We also introduce a new dataset of over 2.4M such texts
mostly co-authored by several popular proprietary LLMs over 23 languages. We
also present findings of our models' performance over each texts of each domain
and generator. Additional findings include comparison of performance against
each adversarial method, length of input texts and characteristics of generated
texts compared to the original human authored texts.