batistado/QuorumBench
Viewer โข Updated โข 1.02k โข 29
How to use batistado/QuorumGuard with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("batistado/QuorumGuard", device_map="auto")batistado/QuorumBenchbatistado/QuorumGuard-Explorergithub.com/batistado/quorumguardQuorumGuard is a model-agnostic consensus controller and GPU priority-preemption scheduler for asynchronous multi-agent LLM committees. It requires zero weight modifications and operates directly on pre-commitment option logits, provenance DAGs, and vLLM request priorities.
pip install git+https://github.com/batistado/quorumguard.git