You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

CVC-Qwen3.5-2B-Instruct

Vision-language instruct model finetuned from Qwen/Qwen3.5-2B-Base. For more info see the 35B-A3B model card.

Dense, 2B parameters: 24 decoder layers plus a 24-layer vision encoder. Weights are bf16.

Training

Two supervised finetuning stages, both at sequence length 16384 on 64 nodes of JUPITER (4x GH200 per node):

  1. Instruct SFT — one pass over the LLaVA-OneVision-1.5-Instruct and Nemotron-VLM-V2 blend, 1139 steps / 16.7B tokens.
  2. Decay anneal — a further 156 steps / 2.3B tokens over the same sources reweighted towards document and OCR data, with the learning rate decayed to zero.

Learning rate 1e-5 for the decoder and projector, 1e-6 for the vision encoder, 100 warmup steps. Images are capped at 1024px on the long side.

Notes

  • Uses the Qwen3.5 chat template. Unlike the upstream instruct template, this one renders <think> blocks on every assistant turn rather than only the last, matching how the model was trained.
  • eos_token is <|im_end|>, and generation_config.json stops on both <|im_end|> (248046) and <|endoftext|> (248044).
Downloads last month
-
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for VLR-CVC/CVC-Qwen3.5-2B-SFT

Finetuned
(104)
this model