prabodha-lenses — fitted workspace-band Jacobian lenses

Pre-fitted band-targeted Jacobian lenses for the prabodha library (recognition-gated workspace steering for language models). These let you skip the multi-hour lens-fitting step and go straight to reading and steering the functional "global workspace" band of six open decoder LLMs — the same lenses the live prabodha app uses for real Jacobian steering.

Provenance. The lens instrument itself is Anthropic's Jacobian-lens (Apache-2.0, from Verbalizable Representations Form a Global Workspace in Language Models, transformer-circuits 2026), vendored unmodified in the prabodha repo. These .pt files are lenses fitted with that instrument on the models below. Utility only — understanding and steering of LLMs. Not a claim about consciousness.

Files

File Model Steering site layer Fit
lens_qwen3_mid30.pt Qwen/Qwen3-4B-Instruct-2507 24 prabodha L10 (band-exit)
gemma-2-2b-it.pt google/gemma-2-2b-it 16 wikitext-2, n_prompts=16
qwen2.5-1.5b-instruct.pt Qwen/Qwen2.5-1.5B-Instruct 17 wikitext-2, n_prompts=16
llama-3.2-1b-instruct.pt meta-llama/Llama-3.2-1B-Instruct 9 wikitext-2, n_prompts=16
smollm2-1.7b-instruct.pt HuggingFaceTB/SmolLM2-1.7B-Instruct 14 wikitext-2, n_prompts=16
nemotron-mini-4b-instruct.pt nvidia/Nemotron-Mini-4B-Instruct 19 wikitext-2, n_prompts=16
lens_qwen3.pt Qwen/Qwen3-4B-Instruct-2507 L1 full/final-target reference
lens_nemotron4b_mid26.pt nvidia/Nemotron-Mini-4B-Instruct 26 prabodha L2b (earlier fit)

lenses_manifest.json carries the machine-readable table (model → lens file → site layer); configs/ carries the matching model + lens-fit YAMLs.

The six top rows are the app-registered lenses. Each was fitted with the same pre-registered pipeline: n_prompts=16, seq_len=128, the wikitext-2-raw-v1 pretraining-like corpus (64×128 word windows, seed 42), target_layer = n_layers − 1 so the fit covers every band site up to the model's depth. The steering site layer is int(0.62 · n_layers) — the workspace band, not the final layer. A lens targeted at the model's final layer is structurally blind to intermediate workspace content — the single most load-bearing instrument finding of the program (gate gate_L2b.json).

Quickstart

pip install prabodha
# grab a lens (e.g. Gemma-2-2B)
hf download qbz506/prabodha-lenses gemma-2-2b-it.pt --local-dir ./lenses
# read the workspace band on a prompt
prabodha lens-vis --model google/gemma-2-2b-it \
  --lens-file ./lenses/gemma-2-2b-it.pt --site-layer 16 \
  --prompt "the fire remembers rivers" --out fire_slice.html

Or steer live in the prabodha app — every model above runs its real fitted lens (direction_source: concept:X), not a contrastive fallback.

Calibration note (important)

Lens-write amplitude is per-model. On most models here a visible steer needs alpha ≈ 1–3; Qwen3-4B is more sensitive (alpha ≈ 0.3). alpha scales inversely with the target's own lens transport strength — calibrate to the plant, don't reuse a fixed value (gate_L13_recipe.json, gate_L14_multiseed.json).

What these are good for (gate-cited)

  • Reading the workspace band — the band is legible only to a lens targeted at its own exit (gate_L2b.json).
  • Recognition-gated steering — event-gated ("sphuraṭṭā", uncommitted-moment) writes steer within an entropy budget; the core confirmed result at 6 seeds (gate_L9_alignconf.json, gate_L11_rep.json). Requires sampling decoding — greedy/argmax mechanically masks decode-time writes (gate_L4b.json).
  • Cross-model transfer via calibration — scale write amplitude to the target plant's own lens transport strength (gate_L13_recipe.json, gate_L14_multiseed.json).

Honest negatives are shipped results too: the āgama-readback acceptance test is a weak, non-oracle predictor (balanced accuracy ~0.59 at n=120) — never a sole acceptance gate. See the paper and the gate files for full detail.

Vocabulary

Internal terms are Sanskrit-forward with engineering glosses: sphuraṭṭā (the pre-linguistic "flash" → the entropy-gated write-timing event), vimarśa (reflexive self-awareness → the verbalizable read-out), svātantrya (autonomy → the entropy budget on writes), āgama re-cognition (→ the read-back acceptance check).

Licensed Apache-2.0. Cite the prabodha repository and Anthropic's Jacobian-lens.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for qbz506/prabodha-lenses

Finetuned
(150)
this model