LoRA Adapter - BERT AI-Text Detector (HC3 reddit_eli5)

LoRA adapter (r=8 on Q/V attention; 296K trainable params = 0.27% of 110M) for bert-base-uncased, trained on the same HC3 reddit_eli5 data as the full fine-tune bert-ai-text-detector-reddit.

Held-out test macro-F1 0.9877 vs the full fine-tune's 0.9935 - the parameter-efficiency comparison study of the project below. The full fine-tune is the deployed model; this adapter exists to validate the PEFT tradeoff empirically.

Full project: https://github.com/lilhuang15/ai-generated-text-detector

Downloads last month
22
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lilhuang15/bert-ai-text-detector-reddit-lora

Adapter
(135)
this model

Dataset used to train lilhuang15/bert-ai-text-detector-reddit-lora