AstroBridge Captioner

n-modality (image + spectra) astronomy captioner. LoRA adapter + fusion stack trained on top of a frozen Qwen/Qwen3.5-9B. The base model itself is NOT included here โ€” load it fresh from Qwen/Qwen3.5-9B and apply this adapter on top.

How to load

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base = AutoModelForCausalLM.from_pretrained(
    "Qwen/Qwen3.5-9B", dtype=torch.bfloat16, trust_remote_code=True
)
llm = PeftModel.from_pretrained(base, "Infonioknight/astrobridge-model-v1")
tokenizer = AutoTokenizer.from_pretrained("Infonioknight/astrobridge-model-v1")

# middle.pt (fusion stack: projectors/modality_identity/qformer/adapter) needs the captioner
# package's FusionStack class to reload โ€” see captioner/model/captioner.py and
# captioner/train/stage1.py's run_stage1 for how it's constructed and wired to the LLM.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Infonioknight/astrobridge-model-v1

Finetuned
Qwen/Qwen3.5-9B
Adapter
(578)
this model