# 00 — Map

## One sentence

Inkling is Thinking Machines’ first open model: a **customization-first**, **native multimodal** sparse MoE transformer (**~975B / 41B active**, **1M** ctx) trained from scratch on **45T** tokens.

## Forward pass (everything hangs off this)

```
text ──embed+norm──┐
image ─40×40 hMLP──┼── residual d=6144 ──► 66× decoder ──► /μP ──► lm_head ──► text
audio ─dMel embed──┘         │
                             │  each layer:
                             │    LN → Attn(SWA|global + relative R + K/V SConv) → SConv → +
                             │    LN → dense MLP (L0–1) or MoE (L2–65) → SConv → +
```

Layer types are **not** guessed — see the generated schedule:

→ [`derived/layer_schedule.md`](../derived/layer_schedule.md)

Canonical numbers:

→ [`derived/SPEC.md`](../derived/SPEC.md)

## Product thesis

| Claim | Consequence |
|---|---|
| Open generalists are commoditizing | Value = **adaptability** |
| Real work is domain-specific | Ship **Tinker** + open weights together |
| Collaboration is multimodal | Image + audio early fusion from day one |
| Cost is a first-class metric | Continuous **thinking effort** |

Authors state Inkling is **not** the strongest overall model; it is a broad base you fine-tune.

## Navigation

| Topic | Doc |
|---|---|
| Architecture | [01-architecture.md](01-architecture.md) |
| Training / effort / safety | [02-training.md](02-training.md) |
| Benchmarks | [03-benchmarks.md](03-benchmarks.md) |
| Inference | [04-inference.md](04-inference.md) |
| Fine-tune / deploy safety | [05-customize.md](05-customize.md) |
| Curriculum | [06-study-plan.md](06-study-plan.md) |
| Code walkthrough | [../code-study/01-modular-walkthrough.md](../code-study/01-modular-walkthrough.md) |
| Chat / tools protocol | [../code-study/02-chat-protocol.md](../code-study/02-chat-protocol.md) |
| Multimodal packing | [../code-study/03-multimodal-io.md](../code-study/03-multimodal-io.md) |
| Class line index | [../derived/class_index.md](../derived/class_index.md) |
| Special tokens | [../derived/special_tokens.md](../derived/special_tokens.md) |
| KV / weight memory | [../derived/memory_notes.md](../derived/memory_notes.md) |

## Primary sources (local)

| Artifact | Path |
|---|---|
| Hub config | `reference/hub/config.json` |
| Model card | `reference/hub/MODEL_CARD.md` |
| Chat template | `reference/hub/chat_template.jinja` |
| Processor | `reference/hub/processor_config.json` |
| HF modular impl | `reference/transformers-inkling/modular_inkling.py` |

Refresh: `make refresh`.