Instructions to use vllm-sr/d3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vllm-sr/d3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-classification", model="vllm-sr/d3", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("vllm-sr/d3", trust_remote_code=True) model = AutoModel.from_pretrained("vllm-sr/d3", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add LEXam (mcq_4_choices) eval result
Why: d3 has no result on LEXam, a registered Hub benchmark whose 4-choice task is closed-set and fits a decision model directly.
Benefit: 61.75 on mcq_4_choices (all 1,655 items, 0 errors), second on the current board.
How: one /v1/systemone request per item with a single choice question; the answer is the argmax of the returned probabilities, with no sampling and no chain of thought. vLLM nightly on one A100 80GB, BF16. Model, dataset and image revisions are pinned in the YAML and the evidence repo: https://huggingface.co/datasets/HappyWindman555/d3-hub-evals
Trade-offs: the other entries are generative models, mostly with thinking and sampling, so the protocols differ. The YAML notes field says so. German items score 50.8 and English items 80.1.