Instructions to use ArthurZ/von with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ArthurZ/von with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ArthurZ/von", device_map="auto") - Notebooks
- Google Colab
- Kaggle
wfzyx/von: decision files
Chat template, settings and head of wfzyx/von for pipeline("decision")
(transformers#49566). The backbone stays the original checkpoint.
from transformers import pipeline
decide = pipeline("decision", model="wfzyx/von", decision_config="ArthurZ/von")
decide({"state": "I was charged twice and want a refund.", "questions": {"refund": {"type": "noul", "instructions": "Is a refund requested?"}}})
decision_template.jinja: the chat template;<|mark|>marks the positions the head reads.decision_config.json: temperatures and option order.decision_head/:VonDecisionHead, converted fromoption_marker.ptof the original.decision_test.json: a request and the input ids that the original code builds for it, used by the tests.
Derived from wfzyx/von (Apache-2.0).
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support