BugSum-Qwen-7B-Distill

This is an experimental self-distillation LoRA variant of BugSum-Qwen-7B for concise English bug-report summarization. It was trained by Md. Abid Shahriar during thesis research.

The repository contains an adapter, not a standalone model. Load it on Qwen/Qwen2.5-Coder-7B-Instruct with PEFT. The training corpus is not included because its source datasets have separate access and licensing conditions.

Method

The experiment used oracle-style self-distillation with supervised negative log-likelihood training on 253 selected examples for three epochs. It started from the supervised BugSum adapter.

The thesis evaluation did not establish a statistically significant improvement over the supervised baseline, so this artifact should be treated as an experimental research checkpoint rather than a proven upgrade.

Intended use and limitations

Use it for research, educational comparison, or human-reviewed bug-summary drafting. It may omit important facts or hallucinate details and should not drive automated production decisions.

Licensing

The base model is distributed separately under Apache-2.0. This adapter is currently shared privately for research review while a project-level release license is finalized. Dataset rights are not transferred.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Abid-Shahriar/BugSum-Qwen-7B-Distill

Base model

Qwen/Qwen2.5-7B
Adapter
(757)
this model