Instructions to use mis2/ChronoReplay-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mis2/ChronoReplay-8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="mis2/ChronoReplay-8B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("mis2/ChronoReplay-8B") model = AutoModelForMultimodalLM.from_pretrained("mis2/ChronoReplay-8B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use mis2/ChronoReplay-8B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "mis2/ChronoReplay-8B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mis2/ChronoReplay-8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/mis2/ChronoReplay-8B
- SGLang
How to use mis2/ChronoReplay-8B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "mis2/ChronoReplay-8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mis2/ChronoReplay-8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "mis2/ChronoReplay-8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mis2/ChronoReplay-8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use mis2/ChronoReplay-8B with Docker Model Runner:
docker model run hf.co/mis2/ChronoReplay-8B
ChronoReplay-8B
Model accompanying ChronoReplay: One Answer Interface Is Not Enough for Streaming Spatial Intelligence.
This is the frozen eight-GPU, seed-42 paper model, initialized from
Qwen/Qwen3-VL-8B-Instruct revision
0c351dd01ed87e9c1b53cbc748cba10e6187ff3b. It retains chronological replay,
native categorical/numeric/temporal answer interfaces, and family-balanced
supervision. The separate four-GPU replication is not substituted for this model.
Contents
Four full safetensors shards, their index, model configuration, tokenizer,
image/video processor configuration, and chat template are included. No adapter
merge is required. Optimizer states, training logs, and saved predictions are
excluded. provenance.json binds the model to its training source;
training_recipe.json records the training configuration.
Loading
import torch
from transformers import AutoProcessor, Qwen3VLForConditionalGeneration
model_id = "mis2/ChronoReplay-8B"
processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3VLForConditionalGeneration.from_pretrained(
model_id, torch_dtype=torch.bfloat16, device_map="auto"
)
Use Transformers 4.57.3 and the accompanying ChronoReplay evaluation entry points for the frozen benchmark observation and decoding protocols. Loading these weights alone does not select an observation-access policy.
Training
- 39,561 serialized training records: 30,635 categorical, 2,545 numeric, and 6,381 supervised OST causal episodes.
- One epoch, global batch 32, learning rate 2e-6, cosine schedule, warmup ratio 0.03, weight decay 0.01.
- Maximum sequence length 32,768; maximum processed pixels per visual item 200,704; bfloat16; frozen visual encoder; trainable language model and merger.
- Seed 42, eight GPUs, microbatch two and accumulation two, GPU-only ZeRO-3.
Resources and terms
The ChronoReplay collection links this model and its training annotations. The implementation is available in the code repository. This release preserves the existing model weights. The base model and source datasets retain their original terms; this card does not relicense third-party materials. The upload is an artifact transfer, not a new training run or benchmark reevaluation.
See CITATION.cff for the author list and citation.
- Downloads last month
- 20
Model tree for mis2/ChronoReplay-8B
Base model
Qwen/Qwen3-VL-8B-Instruct