maxzameer/Mistral-Nemo-Base-2407-ElasticBit

Mistral-Nemo-Base-2407 — MLBricks ElasticBit

Source: mistralai/Mistral-Nemo-Base-2407
Source revision: a4477a2f977929a969745b69bbd62e03043551a5
MLBricks commit: f772eb27d2d6b84764e9e90458827dac6980a88a
ElasticBit threshold: 0.01
Persistent global dtypes: preserved from the source model as loaded for conversion

Conversion result

• Decoder layers: 40
• Parameter-weighted effective bits: 8.221
• Linear storage reduction: 48.59%
• Layer artifact bytes: 9.544 GiB
• Exact global component bytes: 2.500 GiB
• Approximate uploaded inference payload: 12.044 GiB
• Reconstructed end-to-end smoke test: PASS

Validation

Each newly converted layer is checked on calibration inputs, a separate validation input, and a local save/load round trip. Before complete=true, the converter reconstructs global payloads from the uploaded safetensors files, streams every uploaded ElasticBit layer through a real full-model forward, and compares final logits with the pinned FP16 source reference.

Layout

• layers/layer_XXX.elasticbit
• components/global_manifest.json
• components/global_*.safetensors
• reports/layer_XXX.json
• reports/reconstruction_smoke.json
• calibration/input_ids.safetensors
• validation/input_ids.safetensors
• elasticbit_manifest.json
• progress.json

Layer artifacts use a minimal ElasticBit root namespace: compressed Linear paths are stored as block.*. The root class itself is not serialized. A loader should create a small nn.Module with a .block containing the pinned source-compatible decoder architecture, call ElasticBit.load(root, artifact), then use root.block in the reconstructed model while retaining root when controller access is needed.

Review the source model license before redistribution or commercial use.