Von (Verdict-ready)

The Von System One decision model (ModernBERT-large, 395M, English, 8192-token context), exported to ONNX fp32 and packaged for Verdict -- a high-performance serving engine for System One decision models. Serve it with one command:

# CPU host
docker run --rm -p 8080:8080 \
    -v ~/.cache/verdict:/root/.cache/verdict \
    sgyaqing/verdict:0.2.0-cpu serve verdict-models/von --host 0.0.0.0

# GPU host
docker run --rm --gpus all -p 8080:8080 \
    -v ~/.cache/verdict:/root/.cache/verdict \
    sgyaqing/verdict:0.2.0-cuda serve verdict-models/von --host 0.0.0.0

# ModelScope:
docker run --rm -p 8080:8080 \
    -e VERDICT_USE_MODELSCOPE=1 \
    -v ~/.cache/verdict:/root/.cache/verdict \
    sgyaqing/verdict:0.2.0-cpu serve sgyaqing/von --host 0.0.0.0

Endpoints: the standard decision protocols POST /v1/systemone and POST /v1/decisions, native POST /v1/choice | /v1/score | /v1/noul, plus an OpenAI-compatible layer (/v1/chat/completions, /v1/models).

Performance

Measured on one RTX 4090, end to end over HTTP, against the model author's own server (von serve). A ratio above 1x means Verdict is ahead.

concurrency	Verdict rps	von serve rps	rps ratio	Verdict P50 / P99 (ms)	von serve P50 / P99 (ms)	P50 / P99 ratio
1	113.8	46.4	2.45x	8.61 / 11.98	22.89 / 28.46	2.66 / 2.38x
8	536.4	31.2	17.2x	14.86 / 16.61	250.91 / 435.99	16.9 / 26.2x
64	1476.1	22.3	66.1x	42.58 / 53.24	2848.80 / 3333.40	66.9 / 62.6x

Files

File	Purpose
model.json	manifest: graph file name, budgets, family recipe (independent_options), calibration map
von.onnx + von.onnx.data	the ONNX graph (fp32, external weights)
tokenizer/tokenizer.json (+ tokenizer_config.json)	the tokenizer
SHA256SUMS	checksums for every file above

Provenance & fidelity

Weights are unchanged from wfzyx/von; this repo adds only the ONNX export and the serving manifest. Conversion and serving are verified against the golden standard (official von-sdk 1.3.7, CPU fp32, 29-case corpus): identical answers on CPU and on CUDA (RTX 4090).

Accuracy PK — against von serve (von-sdk 1.3.7); both servers on one RTX 4090 (CUDA), graded against the same golden standard:

	Verdict	von serve	result
worst deviation	0.0	0.0	tied

License

Apache-2.0, inherited from the base model. Credit for the model itself belongs to the original author; this repository only repackages it for serving.