autotrust/GEV-26B-Decide: decision files

Chat template, settings and head of autotrust/GEV-26B-Decide for pipeline("decision") (transformers#49566). The backbone is google/gemma-4-26B-A4B-it with the System 1 LoRA of the original (adapter_model.safetensors), loaded by from_pretrained.

from transformers import pipeline

# the LoRA at the root makes `pipeline` load its base model, so the decision files are passed explicitly
decide = pipeline("decision", model="ArthurZ/GEV-26B-Decide", decision_config="ArthurZ/GEV-26B-Decide")
decide({"state": "I was charged twice and want a refund.", "questions": {"refund": {"type": "noul", "instructions": "Is a refund requested?"}}})
  • decision_template.jinja: the chat template; <|mark|> marks the positions the head reads.
  • decision_config.json: temperatures and option order.
  • decision_head/: JevDecisionHead, converted from head.safetensors of the original.
  • decision_test.json: a request and the input ids that the original code builds for it, used by the tests.

Derived from autotrust/GEV-26B-Decide (Apache-2.0).

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArthurZ/GEV-26B-Decide

Finetuned
(1)
this model