- Geni-S1-Ops
- Key capabilities
- Why System-1?
- Architecture
- Recommended serving path
- Example: operational decision request
- Example: image input
- Production evaluation
- Latency
- Model lineage
- Quantization
- Recommended application architecture
- Intended uses
- Out-of-scope / not validated
- Reproducibility metadata
- Suggested repository contents
- Upstream references
- License
- Citation
- Acknowledgements
- Release status
Geni-S1-Ops
Geni-S1-Ops is a fast multimodal System-1 typed-decision model for IT operations, derived from google/diffusiongemma-26B-A4B-it and specialized for operational decision tasks such as command classification, risk, blast radius, reversibility, impact, and explicit abstention/UNKNOWN.
The public checkpoint is the Production model, merged with a tied-weight-safe process and quantized to NVFP4 for low-latency structured-read serving.
What this model is
Geni-S1-Ops is intended to act as a fast System-1 decision layer, not as a conventional chat assistant.
Instead of asking the model to generate a paragraph or JSON token-by-token, applications provide:
- a state,
- one or more typed questions, and
- the allowed decision values.
The model returns probability distributions over the allowed values.
Example:
STATE
command = kubectl scale deployment payments --replicas=0
environment = production
service_tier = critical
QUESTION: What operation is being performed?
CHOICES: OBSERVE | CREATE | MODIFY | DELETE | EXECUTE | UNKNOWN
QUESTION: What is the operational risk?
CHOICES: LOW | MEDIUM | HIGH | CRITICAL | UNKNOWN
Conceptually:
Operational state
|
v
DiffusionGemma System-1
|
+--> operation -> MODIFY
+--> risk -> HIGH
+--> blast_radius -> SERVICE
+--> reversibility -> FULL
+--> affects_data -> NO
+--> UNKNOWN / abstention probabilities
The intended execution pattern is:
State
|
v
Geni-S1-Ops
|
v
Typed DecisionVector
|
v
Deterministic policy / authorization
|
v
Action Gateway / workflow executor
The model should provide semantic evidence and probabilities. Final authorization should remain in deterministic policy.
Key capabilities
Trained capabilities
It was fine-tuned for IT/SRE operational typed decisions, including:
- command operation classification,
- operational risk,
- blast radius,
- reversibility,
- read-only vs state-changing behavior,
- destructive behavior,
- privilege requirements,
- availability impact,
- data impact / data-loss possibility,
- configuration impact,
- security impact,
- restart/downtime semantics,
- explicit
UNKNOWN/ insufficient-information behavior, - parallel typed decision vectors.
The exact application schema can be supplied at inference time. The model is not restricted to a single fixed classifier head.
Preserved multimodal capabilities
The operational fine-tune preserved DiffusionGemma's native visual grounding behavior.
On a 100-example ScreenSpot grounding probe:
| Model | Point-in-bbox |
|---|---|
| Base DiffusionGemma NVFP4 | 0.838 |
| Geni-S1-Ops NVFP4 | 0.854 |
The comparison is small (n=100), so the difference should be treated as directional. The load-bearing result is no observed degradation in grounding after operational fine-tuning, merge, quantization, and serving.
Grounding coordinates use the Gemma-family 0–1000 normalized coordinate convention in this evaluation.
Why System-1?
The design goal is a fast decision layer:
state + typed questions + allowed values
|
v
probability distributions
rather than:
prompt
|
v
long autoregressive generation
|
v
parse free-form answer
This makes the model useful for high-frequency operational decision points where latency, type safety, calibrated uncertainty, and deterministic downstream policy matter.
Architecture
Geni-S1-Ops is based on DiffusionGemma 26B-A4B, a sparse Mixture-of-Experts diffusion language model.
The upstream model has approximately:
- 25.2B total parameters,
- ~3.8B active parameters,
- multimodal text + image input,
- a diffusion decoder that operates on token canvases rather than conventional left-to-right decoding.
For structured decision serving, questions are represented on the decision canvas and read in parallel.
Conceptually:
STATE + QUESTIONS
|
v
DiffusionGemma
|
decision canvas
+-----------------+------------------+
| | |
operation risk blast_radius
| | |
v v v
distribution distribution distribution
| | |
+-----------------+------------------+
|
v
Typed DecisionVector
This is the core reason a single model can evaluate many decision fields with low latency.
Recommended serving path
The checkpoint was validated with the djev-spark structured-read serving pattern:
vLLM structured-read engine
|
v
structured decision server (POST /v1/systemone)
The djev-spark server implements a Jev-compatible POST /v1/systemone API and also supports image inputs.
Validated serving stack (exact)
These are the components and flags this checkpoint's published evaluation numbers were measured with:
| Component | Version / value |
|---|---|
| vLLM | 0.29.1rc1.dev347+gdee37d891 (structured-read build shipped inside the djev-spark image) |
| transformers (inside image) | 5.17.0 |
| djev-spark recipe | https://github.com/mmastrac/djev-spark @ commit 1444f3e927f83ba508e5b28a4fd4fdd9ecd0976b |
| Hardware | NVIDIA DGX Spark (GB10, 128 GB unified memory), CUDA 13.0 |
| Attention backend | TRITON_ATTN |
| Decision canvas | 128 tokens |
| Measured latency (18 questions, 1 read) | P50 144–149 ms, P95 155–159 ms |
Equivalent vllm serve invocation (as run inside the validated container):
vllm serve /models/Geni-S1-Ops-26B-A4B-NVFP4 \
--served-model-name Geni-S1-Ops \
--max-num-seqs 8 \
--max-model-len 4096 \
--attention-backend TRITON_ATTN \
--gpu-memory-utilization 0.40 \
--kv-cache-memory 2147483648 \
--max-logprobs 32 \
--enable-prefix-caching \
--diffusion-config '{"canvas_length": 128}' \
--override-generation-config '{"max_new_tokens": null}' \
--async-scheduling
The structured decision server (started by the djev-spark entrypoint) then
exposes POST /v1/systemone (default port 8011) in front of the vLLM engine
(default port 8010).
Notes:
- Structured reads (
diffusion_seed_canvas/ read-only denoise logprobs) depend on this vLLM build line until equivalent support is fully upstream; a stock vLLM release may refuse the request shape or the model's LoRA interface (DiffusionGemmaForConditionalGeneration does not support LoRA yetat the time of validation). This checkpoint is fully merged and quantized precisely so the serving path needs no adapter loading. processor_config.jsonmust be present next to the weights (the image processor config is required by the serving stack).
Example: operational decision request
curl -s http://localhost:8011/v1/systemone \
-H 'content-type: application/json' \
-d '{
"model": "Geni-S1-Ops",
"instructions": "Classify operational semantics using the supplied state. Risk depends on environment, redundancy, service criticality, blast radius, reversibility, and data/security impact. Use UNKNOWN when the supplied state is insufficient.",
"state": {
"command": "kubectl scale deployment payments --replicas=0",
"platform": "kubernetes",
"environment": "production",
"current_replicas": 3,
"service_tier": "critical"
},
"questions": {
"operation": {
"type": "choice",
"instructions": "What operation is being performed?",
"criteria": {
"OBSERVE": null,
"CREATE": null,
"MODIFY": null,
"DELETE": null,
"EXECUTE": null,
"UNKNOWN": null
}
},
"risk": {
"type": "choice",
"instructions": "What is the operational risk?",
"criteria": {
"LOW": null,
"MEDIUM": null,
"HIGH": null,
"CRITICAL": null,
"UNKNOWN": null
}
},
"blast_radius": {
"type": "choice",
"instructions": "What is the most likely blast radius?",
"criteria": {
"OBJECT": null,
"SERVICE": null,
"HOST": null,
"CLUSTER": null,
"ENVIRONMENT": null,
"UNKNOWN": null
}
},
"reversible": {
"type": "choice",
"instructions": "How reversible is the operation?",
"criteria": {
"FULL": null,
"PARTIAL": null,
"NONE": null,
"UNKNOWN": null
}
}
},
"samples": 1,
"steps": 1,
"think": 0,
"sequential": false
}'
Application code should map returned values into strongly typed enums / schemas before policy evaluation.
Example: image input
The structured server can receive one or more images as multipart form data.
curl -s http://localhost:8011/v1/systemone \
-F 'request={
"model":"Geni-S1-Ops",
"state":{
"goal":"Identify whether the Restart button is visible"
},
"questions":{
"target_visible":{
"type":"choice",
"instructions":"Is the requested UI target visible?",
"criteria":{
"YES":null,
"NO":null,
"UNKNOWN":null
}
}
}
}' \
-F 'screen=@screenshot.png'
S1-Ops has preserved visual grounding, but GUI action selection is not yet a trained capability.
Production evaluation
The final checkpoint was evaluated after tied-weight-safe merge, ModelOpt NVFP4 quantization, and real serving.
The evaluation sets below are internal fresh blind sets designed for this project. They are not public standard benchmarks.
Representative blind set
| Metric | BF16 | NVFP4 served |
|---|---|---|
| Macro-F1 | 0.815 | 0.852 |
| UNKNOWN recall | 0.899 | 0.993 |
| CRITICAL recall | 0.800 (n=10) |
0.500 (n=10) |
| ECE | ~0.012 | ~0.029 |
Quantization note
On the small representative CRITICAL slice, post-quantization recall shifted from 8/10 to 5/10.
All five misses were adjacent:
CRITICAL -> HIGH
There were no observed:
CRITICAL -> MEDIUM
CRITICAL -> LOW
errors in this slice.
The support is small (n=10), so this boundary should be monitored on larger future blind sets.
Safety-stress blind set
| Metric | BF16 | NVFP4 served |
|---|---|---|
| Macro-F1 | 0.664 | 0.666 |
| UNKNOWN recall | 0.657 | 0.819 |
| CRITICAL recall | 1.000 (35/35) |
1.000 (35/35) |
| ECE | 0.033 | 0.034 |
Observed safety-error geometry on the stress evaluation was predominantly conservative:
- zero observed
CRITICAL -> LOW/MEDIUM, - zero observed data-loss misses,
- one destructive miss,
- three availability misses,
- major risk confusions were predominantly
HIGH -> CRITICALandMEDIUM -> HIGH, - UNKNOWN false-positive rate was approximately 3.3%.
This means much of the remaining macro-F1 loss on the stress set came from over-escalation, not dangerous risk under-calling.
Latency
Measured served NVFP4 latency for the operational structured-read path:
| Metric | Latency |
|---|---|
| P50 | 144–149 ms |
| P95 | 155–159 ms |
For comparison, the same adapted model evaluated through an unoptimized in-process Transformers path was approximately ~1.1 s; that number should not be used as the serving benchmark.
Latency will vary with:
- hardware,
- number of questions,
- canvas settings,
- image inputs,
samples,- denoise
steps, - context length,
- serving engine and kernel version.
Model lineage
google/diffusiongemma-26B-A4B-it
|
v
operational fine-tune
|
v
tied-weight-safe merge
|
v
validation consistency gate
|
v
NVIDIA ModelOpt NVFP4 PTQ
|
v
djev/vLLM serving
|
v
Geni-S1-Ops
Tied-weight merge note
DiffusionGemma contains tied/aliased encoder and decoder parameters.
During deployment work, hundreds of decoder tensors were runtime aliases of encoder tensors. A naïve verification path with adapters still active caused deltas to be effectively double-applied and failed the consistency gate.
The deployment pipeline therefore used a tied-weight-aware process:
identify aliases
|
untie / materialize per path
|
merge adapter exactly once per path
|
disable adapters
|
verify
|
save using original shard/index structure
|
ModelOpt quantization
If reproducing this model from the training adapter, do not assume a generic merge path is sufficient without validating tied-weight behavior.
Quantization
The public serving checkpoint is intended to be the NVFP4 artifact, not the raw BF16 training checkpoint.
The deployment conversion used NVIDIA ModelOpt's DiffusionGemma-oriented NVFP4 workflow and operational decision prompts representative of the real inference distribution as PTQ calibration inputs.
After quantization, the checkpoint was re-evaluated for:
- macro-F1,
- UNKNOWN recall,
- CRITICAL recall,
- calibration,
- safety error direction,
- serving latency.
Quantization therefore forms part of the validated model artifact, rather than being treated as a purely mechanical post-processing step.
Recommended application architecture
Geni-S1-Ops should not directly authorize infrastructure changes.
Operational state
|
v
Geni-S1-Ops
|
Typed decisions
|
confidence / UNKNOWN
|
v
Deterministic policy
authorization / approval / RBAC
|
v
Action Gateway
|
v
Environment
Example:
IF environment == PROD
AND risk IN {HIGH, CRITICAL}
AND destructive == YES
THEN
REQUIRE enhanced validation / approval
The post-quantization representative evaluation observed some adjacent CRITICAL -> HIGH movement. For high-impact production operations, policy should therefore avoid making the safety boundary depend on a single distinction between HIGH and CRITICAL.
Intended uses
Good fits include:
- command classification,
- operational risk assessment,
- blast-radius estimation,
- change semantics,
- incident / alert typed decisioning,
- fast pre-policy classification,
- automation confidence / abstention signals,
- high-frequency System-1 decisions before a larger reasoning model,
- multimodal operational screen interpretation,
- research on typed probabilistic decision models.
A common architecture is:
Geni-S1-Ops
|
+--> confident typed decision --> policy/action
|
+--> UNKNOWN / uncertain --> larger System-2 model or human
Out-of-scope / not validated
This release should not be assumed to provide:
- unrestricted autonomous command execution,
- final authorization decisions,
- production-safe behavior outside the evaluated ontology without testing,
- a complete computer-use action policy,
- browser / Windows multi-step task completion,
- guaranteed calibrated probabilities on arbitrary domains,
- guaranteed safety for unseen infrastructure environments,
- a substitute for deterministic parsing when exact structured facts are available.
If Kubernetes / cloud / OS APIs already return an exact structured fact, parse it deterministically rather than asking the model to infer it.
Reproducibility metadata
base checkpoint: google/diffusiongemma-26B-A4B-it (BF16, pulled 2026-09-21)
training adapter sha256: e3ce1837c3d2edf3acac88e3d5ba2891a511fc518d4a20a0d5b5f00f663e595a (adapter_model.safetensors, 88 MB)
merged BF16 shard[1] sha256: ed1bdac2da6c69dd2bfe7baad0cad2481cdbd61d9c68e1dbe43bea65989f2d31
merged BF16 shard[11] sha256: a3975c358897ac3ec8526af58dc48d1f255fadada2e167c46b20fa421c948c98
NVFP4 shard 1 sha256: 26ad0fcfbe05a693d3b2278f98e11d8db2ba7a7e6214806973af522c6f9b8446
NVFP4 shard 2 sha256: 50214dc9b60e9eed5b8ce8a0b21fea335af6e6c79e90013db59569133b10b96e
ModelOpt version: nvidia-modelopt 0.46.1
PTQ recipe: model_type/diffusion_gemma/ptq/nvfp4_experts_only (NVFP4 W4A4 experts; attention/dense MLP/self-conditioning BF16; FP8 KV cast; max calibration, 256 samples)
vLLM version / commit: 0.29.1rc1.dev347+gdee37d891 (djev-spark image)
djev-spark commit: 1444f3e927f83ba508e5b28a4fd4fdd9ecd0976b
training dataset: internal operational decision corpus (1,283 states, ~23K labeled decisions) - not published
PTQ calibration dataset: 256 rendered decision prompts from the training distribution - not published
evaluation datasets: internal fresh blind sets (representative-200, safety-stress-100) - not published; metric summaries in evals/
schema version: SYSTEM1_OPERATIONAL_V1 (18 model fields)
Recommended versioning:
model: Geni-S1-Ops v1.0
schema: SYSTEM1_OPERATIONAL_V1
precision: NVFP4
Suggested repository contents
.
├── README.md
├── LICENSE
├── config.json
├── processor_config.json
├── tokenizer.json
├── tokenizer_config.json
├── model.safetensors.index.json
├── model-*.safetensors
│
├── schemas/
│ └── system1_operational_v1.json
│
├── examples/
│ ├── operational_request.json
│ ├── curl_operational.sh
│ └── curl_image.sh
│
└── evals/
├── representative_metrics.json
├── stress_metrics.json
└── screenspot_probe.json
A separate research repository may optionally contain the raw LoRA adapter and training recipe.
Upstream references
DiffusionGemma base model:
https://huggingface.co/google/diffusiongemma-26B-A4B-itdjev-spark structured-read serving reference:
https://github.com/mmastrac/djev-sparkNVIDIA ModelOpt:
https://github.com/NVIDIA/Model-Optimizer
License
The upstream google/diffusiongemma-26B-A4B-it model is published under the Apache License 2.0.
This repository should include the applicable license and preserve upstream attribution. Users should review the upstream model card, license, and usage/safety guidance before deployment.
Citation
@misc{geni_s1_ops,
title = {Geni-S1-Ops: A Multimodal System-1 Typed Decision Model for IT Operations},
author = {Microland},
year = {2026},
howpublished = {Hugging Face model release}
}
Acknowledgements
Geni-S1-Ops builds on:
- DiffusionGemma by Google DeepMind,
- NVIDIA ModelOpt for deployment quantization,
- vLLM structured-read work,
- the djev-spark reference implementation for DiffusionGemma structured decisions.
Release status
Geni-S1-Ops: production-path model frozen.
Validated capabilities:
typed operational decisions YES
explicit UNKNOWN behavior YES
multimodal image input YES
UI visual grounding preserved YES
NVFP4 structured serving YES
- Downloads last month
- 28
Model tree for microlandltd/Geni-S1-Ops-26B-A4B-NVFP4
Base model
google/diffusiongemma-26B-A4B-it