AstroBridge Captioner
n-modality (image + spectra) astronomy captioner. LoRA adapter + fusion stack trained on top of
a frozen Qwen/Qwen3.5-9B. The base model itself is NOT included here โ load it fresh from
Qwen/Qwen3.5-9B and apply this adapter on top.
How to load
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch
base = AutoModelForCausalLM.from_pretrained(
"Qwen/Qwen3.5-9B", dtype=torch.bfloat16, trust_remote_code=True
)
llm = PeftModel.from_pretrained(base, "Infonioknight/astrobridge-model-v1")
tokenizer = AutoTokenizer.from_pretrained("Infonioknight/astrobridge-model-v1")
# middle.pt (fusion stack: projectors/modality_identity/qformer/adapter) needs the captioner
# package's FusionStack class to reload โ see captioner/model/captioner.py and
# captioner/train/stage1.py's run_stage1 for how it's constructed and wired to the LLM.
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support