Image-Text-to-Text
PEFT
Safetensors
English
lora
agentic
tool-use
function-calling
vision-language
bird-identification
dpo
Instructions to use Chinzhu/BirdAgent-Qwen3VL-4B-DPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Chinzhu/BirdAgent-Qwen3VL-4B-DPO with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-VL-4B-Instruct") model = PeftModel.from_pretrained(base_model, "Chinzhu/BirdAgent-Qwen3VL-4B-DPO") - Notebooks
- Google Colab
- Kaggle
BirdAgent β Qwen3-VL-4B agentic bird identifier (on-policy DPO)
LoRA adapter on Qwen/Qwen3-VL-4B-Instruct.
This is the on-policy DPO stage of BirdAgent (see the flagship
Chinzhu/BirdAgent-Qwen3VL-4B
GSPO model for the full description, tools, results, and figures).
π Paper (under review) Β· π» Code Β· π Benchmarks
- Stage: on-policy DPO on top of SFT, optimizing soft preferences only β ledger discipline, call parsimony, turn ordering β never grain or abstention (those belong to RL). Pairs are perturbed SFT gold trajectories (chosen = gold; rejected = gold + one redundant call, verdict unchanged).
- What it buys: calibration sharpening β species-declaration precision 0.33 β 1.0 (the agent stops naming species it cannot support). Pooled solve 0.34 overall (beats Sonnet, second only to Opus among all conditions).
- Adapter: LoRA
r=64,alpha=128,dropout=0.05(trained bf16, adapter saved fp32); targets language-modelq/k/v/o/gate/up/down_proj. - Note: this checkpoint is the initialization for GSPO; the released agent is the GSPO model, which adds orchestration on top (pooled 0.34 β 0.35). Same intended use, limitations, and responsible-use terms as the flagship card.
Citation
@inproceedings{wang2026birdagent,
title = {BirdAgent: A Small Vision--Language Model that Orchestrates
Domain Tools Beats Large Models that Merely Hold Them},
author = {Wang, Xinzhu},
booktitle = {Under review},
year = {2026}
}
- Downloads last month
- 17
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support
Model tree for Chinzhu/BirdAgent-Qwen3VL-4B-DPO
Base model
Qwen/Qwen3-VL-4B-Instruct