chaoliangUNSW/Jev-Style-2B-Decision-v4.2-MLX

Jev-Style-2B-Decision-v4.2 MLX

Text-only precision variants of Jev-Style-2B-Decision-v4.2, a diagnostic continuation candidate in the v4 lineage. The language model has 1,881,825,088 parameters before quantization. Given a state and typed questions, the custom runtime returns a probability for every supplied option.

Files

Folder	Stored weights	Compute setting
bf16/	BF16	FP32 activations
8bit/	8-bit affine, group64	Native BF16 activations

Use

Use Apple silicon and Python 3.12:

python -m pip install -r requirements.txt
python jev_style_decision_mlx.py --precision 8bit \
  --state "The parcel arrived undamaged." --question "Was the delivery successful?"

Select --precision bf16 or --precision 8bit. Keep the root release_config.json, readout_config.json and the precision folder's macjev_norms_fp32.safetensors with the weights. The BF16 files use FP32 activations as configured in release_config.json; the 8-bit files use native BF16 activations. The runtime pins and checks mlx-lm 0.31.3 internals. Use this custom decision runtime rather than stock chat generation.

Model protocol

• Question types: choice, noul and score; option order is preserved.
• Readout: verdict hidden states dotted with the tied yes/no embedding-row difference, followed by softmax.
• Global temperature: 0.8813575635811984 for all three question types.
• Attention: the trained block-attention protocol, with shared state computation for multiple questions.
• Input budget: 32,768 tokens, at most 255 options; over-budget requests are rejected.
• Text and JSON inputs. Use the main HF model for images.

Public result and lineage

The original HF model scored 46.74 on the complete self-run Decision Index public 0.3 suite, with 140,178 successful scored requests. That result was measured with the original PyTorch BF16 CUDA model. The complete result bundle and main model card provide the evaluation settings, training lineage and diagnostic-release details.

This follows the v4 lineage, including TypeSafe Jev 1.14 API soft-label distillation and generated/upstream training material. JevStyle is independently maintained by Chaoliang Yan, without TypeSafe affiliation or endorsement. Apache-2.0 for these weights does not relicense third-party data or teacher outputs. Read LICENSE, NOTICE and the parent model card.

manifest.json records release file sizes and SHA256 values; release_config.json records source weights, precision settings and conversion details.