⚠️ Deprecated — Ticket Classifier (v1)
This model is deprecated. It was trained on a synthetic dataset with a known labeling
issue in the general category (see details below), which significantly understated its
usable accuracy. It is kept here only for reproducibility and as a before/after reference.
Use sheethal00/ticket-classifier-lora instead.
Why this version was deprecated
The data generation prompt for the general category had no positive definition
("everything else"), causing generated tickets to overlap heavily with the other four
categories. This model's real classification ability was masked by noisy validation
labels — measured accuracy was 71.7% / F1 (macro) 0.704, compared to 95.1% / 0.953
after the labeling issue was fixed and the model retrained. See the main repo's model
card for the full before/after comparison.
Training details
Same architecture and hyperparameters as v2 (LoRA rank 16, alpha 32, target modules q_proj/v_proj, base model meta-llama/Llama-3.2-1B) — the only difference is the training data quality.