language-perceiver-mic

Slim model weights, executable usage and framework expectations in one repository.

Contract

Perceiver masked language modeling

Runnable usage and the framework expectations directory are linked above.

Slim model

Slim fixture: language-perceiver-mic

A 194.1M-parameter fixture for the Perceiver MIC, covering deepmind/language-perceiver. It is a test artifact, not a usable model, tagged test-artifact to keep it out of candidate-model search.

  • Fixture key de355e4dc541. It covers every checkpoint whose processor files are byte-identical and whose config matches after shrinking.
  • Same architecture, smaller config: PerceiverForMaskedLM, shrunk by the generic rule in sweep.py ().
  • Processor files copied byte for byte from deepmind/language-perceiver: special_tokens_map.json, tokenizer_config.json.
  • Random weights (seed 17). They passed the input-sensitivity gate: every perturbation of the contract's inputs moved the logits by at least 0.001 (weakest: attention_mask:all_ones, 0.106), so no training was needed.
  • Same tensor names as the real checkpoint. The real checkpoint has every parameter, and so does the fixture.
  • Saved in float32, the dtype deepmind/language-perceiver loads in by default.
  • Finite in float32, bfloat16, and float16 (forward, loss, gradients).

Built by build_fixtures.py; build.json records the pinned sources, gate results, and file hashes. This repository includes the slim weights, usage and framework expectations; rebuild the other files with python example/build_fixtures.py --fixture language-perceiver-mic.

Downloads last month
437
Safetensors
Model size
0.2B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for huggingface-mic/language-perceiver-mic

Finetuned
(2)
this model