metadata
base_model: fastino/gliner2-large-v1
library_name: peft
tags:
- base_model:adapter:fastino/gliner2-large-v1
- lora
- transformers
- text-classification
- gliner
Dataset Mention Classification Model
This is a fine-tuned sequence classification model for identifying the presence of dataset mentions in text. It is built as a LoRA adapter on top of the fastino/gliner2-large-v1 base model.
It serves as the default pre-filtering stage (page-relevance classifier) in the ai4data dataset extraction pipeline, helping skip pages/documents that do not contain dataset references before performing detailed entity and relation extraction.
Model Details
- Base Model:
fastino/gliner2-large-v1 - Adapter Type: PEFT / LoRA
- Task: Sequence Classification
- Task Name:
has_data_mention - Labels:
["has_mention", "no_mention"]
How to Use
You can load and use this model directly via gliner2 and the PeftModel interface:
from gliner2 import GLiNER2
from peft import PeftModel
# Load base model and apply adapter
base_model = GLiNER2.from_pretrained("fastino/gliner2-large-v1")
model = PeftModel.from_pretrained(base_model, "ai4data/datause-classifier")
model.eval()
# Define classification tasks
TASKS = {"has_data_mention": ["has_mention", "no_mention"]}
text_with_data = "This paper uses microdata from the 2018 Nigeria General Household Survey."
text_no_data = "The project will strengthen institutional capacity and governance frameworks."
# Run inference
res1 = model.classify_text(text_with_data, TASKS, threshold=0.0, include_confidence=True)
print(res1)
# Output: {'has_data_mention': {'label': 'has_mention', 'confidence': 1.0}}
res2 = model.classify_text(text_no_data, TASKS, threshold=0.0, include_confidence=True)
print(res2)
# Output: {'has_data_mention': {'label': 'no_mention', 'confidence': 0.998}}