FoolDev commited on
Commit
4811e8d
Β·
1 Parent(s): 72259c1

Revert "docs: align README + CHANGELOG + Modelfile + examples with the qwen36 re-stamp (07fa120)"

Browse files

This reverts commit e9c7366, restoring the collapsed-workaround
narrative now that the HF bundle is back on qwen35 (upload 72259c1).
A fresh-pull integration test on the Strix Halo reference machine
reproduced the heal-hf friction end-to-end; the friction was worse
in practice than the architectural-honesty payoff. CHANGELOG
[Unreleased] picks up a "Round trip" bullet documenting the
qwen35 -> qwen36 -> qwen35 sequence; net blob is 5ed60d0a... again,
same as before the round trip.

Files changed (4) hide show
  1. CHANGELOG.md +49 -34
  2. Modelfile +10 -20
  3. README.md +58 -87
  4. examples/README.md +11 -13
CHANGELOG.md CHANGED
@@ -8,43 +8,58 @@ and documentation**, not the underlying base model.
8
  ## [Unreleased]
9
 
10
  ### Changed
11
- - **Bundle re-stamped `general.architecture: 'qwen35'` β†’ `'qwen36'`**
12
- in commit `07fa120` (HF-direct `hf upload`). Re-reverses 964e418,
13
- returning to the v0.6.0 stamp choice from `e1f78fa`. Tensor data
14
- is byte-identical across all three flips; only the
15
- `general.architecture` KV (and the namespaced KV keys) moves.
16
- The new blob SHA
17
- `b2b63b941d714b0aff5e9afc9b337e7607b84e371ba991c182d92d0f7805c0e9`
18
- is **bit-identical to the original v0.6.0 qwen36 bundle** β€”
19
- content-addressed return to a known artifact, so anyone who pulled
20
- v0.6.0 still has a usable cached blob; `make heal-hf` will skip
21
- the re-fetch if their old blob is still in the store.
22
- The flip restores the architecturally-honest label even though
23
- upstream `qwen36` arch support is still not present in
24
- `ggml-org/llama.cpp` or `ollama/ollama` as of 2026-05-19 (verified
25
- by recheck; no open PR adds it). Day-to-day cost of the qwen36
26
- stamp is back: a fresh `ollama run hf.co/FoolDev/Thanatos-27B`
27
- pulls 17 GB and 500s with `unable to load model: <blob>`,
28
- requiring one `make heal-hf` to rebadge in place before the same
29
- tag loads. The trade-off here favors honesty + matching the
30
- upstream Qwen 3.6 family identity over no-rebadge ergonomics
31
- on the HF-bridge path.
32
- - README "Heads up" callout, three-path TL;DR, Architecture
33
- workaround prose, Modelfile preamble, and `examples/README.md`
34
- Ollama setup all restored to the pre-collapse form (i.e. the
35
- v0.6.0-era doc surface, updated for the new SHA and the third
36
- flip). `scripts/rename_arch.py` example direction in
37
- Architecture flipped back to qwen36 β†’ qwen35 β€” the rebadge
38
- direction users actually run to make the bundle loadable, not
39
- the future-honesty direction.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
40
 
41
  ### Note
42
  - `make heal-hf`, `make load-bundle`, and `scripts/rename_arch.py`
43
- are now back to load-bearing rather than dormant.
44
- `make heal-hf` is the canonical recovery path; `make load-bundle`
45
- builds a separate local tag without touching the HF-bridge
46
- manifest; `make build` bypasses the bundle entirely (downloads
47
- qwen35-stamped from unsloth).
48
 
49
  ### Added
50
  - `scripts/check.sh` now greps for the `VAR="$(cmd 2>/dev/null | filter)"`
 
8
  ## [Unreleased]
9
 
10
  ### Changed
11
+ - **Bundle re-stamped `general.architecture: 'qwen36'` β†’ `'qwen35'`**
12
+ in commit 964e418 (HF-direct `hf upload`). Reverses the v0.6.0
13
+ `qwen36` stamp from e1f78fa, which itself flipped qwen35 β†’ qwen36
14
+ deliberately. The proximate trigger: today's subagent recheck
15
+ found no PR or tracking issue for a `qwen36` arch entry in either
16
+ `ggml-org/llama.cpp` or `ollama/ollama`, and the actual Qwen 3.6
17
+ family upstream already loads under `qwen35moe` β€” so the qwen36
18
+ stamp was going to stay ahead-of-upstream indefinitely, not for a
19
+ release or two. Day-to-day cost (every fresh
20
+ `ollama run hf.co/FoolDev/Thanatos-27B` hitting a 500, every user
21
+ needing `make heal-hf` to recover) outweighed the
22
+ architectural-honesty benefit. Tensor data stays byte-identical;
23
+ only the `general.architecture` KV (and the namespaced KV keys)
24
+ flips. New bundle blob SHA is
25
+ `5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0`
26
+ β€” the same hash `make load-bundle` and `make heal-hf` have been
27
+ producing locally this whole session.
28
+ - README "Heads up" callout (qwen36 load-failure warning) removed.
29
+ TL;DR collapsed back from "three paths around it" to a single
30
+ one-liner: `ollama run hf.co/FoolDev/Thanatos-27B` now loads on
31
+ stock Ollama. `make heal-hf` is mentioned as the recovery path
32
+ for anyone who pulled the v0.6.0 bundle and still has the qwen36
33
+ blob in their store.
34
+ - README "Architecture" section, Quick start option A,
35
+ `examples/README.md` Ollama setup, and `Modelfile` preamble all
36
+ collapsed back to the pre-qwen36 single-path narrative. The
37
+ long "qwen36 is unloadable / here are the workarounds" prose
38
+ was replaced with a one-paragraph history note pointing at
39
+ commit 964e418 + the [CHANGELOG](CHANGELOG.md) entry. Net -39
40
+ lines across the three doc surfaces. `scripts/rename_arch.py`
41
+ example in Architecture flipped from qwen36 β†’ qwen35 to qwen35
42
+ β†’ qwen36 to match its new "tool kept around for future flips"
43
+ framing.
44
+ - **Round trip (2026-05-19 evening).** The bundle briefly flipped
45
+ back to `qwen36` in commit `07fa120` plus the doc re-expansion
46
+ in `e9c7366`, on the theory that architectural-honesty was worth
47
+ the heal-hf friction. A fresh-pull integration test on the
48
+ Strix Halo box reproduced the friction end-to-end (`ollama run`
49
+ 500 on first pull, recover via `make heal-hf`, smoke-test then
50
+ passed) β€” and the friction was worse in practice than the doc
51
+ prose suggested. Reverted to qwen35 in `hf upload` commit
52
+ `72259c1` + the present commit (revert of `e9c7366`). Net
53
+ bundle state: same `5ed60d0a...` blob as before the round
54
+ trip; no user-facing impact unless a user happened to pull in
55
+ the ~1 hour window when the bundle was qwen36-stamped (for
56
+ them, one `make heal-hf` is the recovery).
57
 
58
  ### Note
59
  - `make heal-hf`, `make load-bundle`, and `scripts/rename_arch.py`
60
+ stay in the repo and stay useful. heal-hf is idempotent on qwen35
61
+ (skips early); load-bundle does a no-op rebadge on a qwen35 bundle
62
+ and runs `ollama create` as normal.
 
 
63
 
64
  ### Added
65
  - `scripts/check.sh` now greps for the `VAR="$(cmd 2>/dev/null | filter)"`
Modelfile CHANGED
@@ -7,28 +7,18 @@
7
  # image input, or wait for the fix. See the Vision section in README.md.
8
  #
9
  # This repo bundles a single GGUF: Thanatos-27B.Q4_K_M.gguf (~17 GB),
10
- # stamped `general.architecture: 'qwen36'` β€” the architecturally-honest
11
- # label for the Qwen 3.6 family. No released llama.cpp / Ollama
12
- # recognizes that string yet; both register the stack as
13
- # `qwen35` / `qwen35moe`. A direct `ollama create -f Modelfile`
14
- # against the bundle therefore fails with
15
- # `unknown model architecture: 'qwen36'`. Two recovery paths:
16
- #
17
- # make load-bundle # one-shot: smudge LFS pointer, rebadge a local
18
- # # copy qwen36 -> qwen35, run `ollama create`.
19
- # make heal-hf # rebadge an already-pulled `hf.co/...` tag's
20
- # # blob in place (qwen36 -> qwen35) and rewrite
21
- # # the manifest digest.
22
- #
23
- # See README "Architecture" for the qwen35 -> qwen36 -> qwen35 ->
24
- # qwen36 stamp history through commit 07fa120.
25
  #
26
  # For other quants (Q3_K_S, Q5_K_M, Q6_K, etc.), `make build QUANT=Q3_K_S`
27
- # downloads the chosen quant from unsloth/Qwen3.6-27B-GGUF (qwen35-stamped,
28
- # loads on stock loaders, no rebadge needed) and patches FROM in a temp
29
- # Modelfile copy. The Q3_K_S used to ship in this repo; it was removed so
30
- # HF's Ollama bridge picks Q4_K_M as the default `:latest` tag instead of
31
- # Q3_K_S (alphabetically-first heuristic).
32
  #
33
  # Other GGUF sources (use with `make build GGUF_PATH=...`):
34
  # https://huggingface.co/unsloth/Qwen3.6-27B-GGUF
 
7
  # image input, or wait for the fix. See the Vision section in README.md.
8
  #
9
  # This repo bundles a single GGUF: Thanatos-27B.Q4_K_M.gguf (~17 GB),
10
+ # stamped `general.architecture: 'qwen35'` β€” the arch entry every
11
+ # released llama.cpp / Ollama loads under for the Qwen 3.6 hybrid
12
+ # SSM + attention family. `ollama create thanatos-27b -f Modelfile &&
13
+ # ollama run thanatos-27b` loads it directly. See README
14
+ # "Architecture" for the qwen35 -> qwen36 -> qwen35 history through
15
+ # v0.6.0.
 
 
 
 
 
 
 
 
 
16
  #
17
  # For other quants (Q3_K_S, Q5_K_M, Q6_K, etc.), `make build QUANT=Q3_K_S`
18
+ # downloads the chosen quant from unsloth/Qwen3.6-27B-GGUF and patches
19
+ # FROM in a temp Modelfile copy. The Q3_K_S used to ship in this repo;
20
+ # it was removed so HF's Ollama bridge picks Q4_K_M as the default
21
+ # `:latest` tag instead of Q3_K_S (alphabetically-first heuristic).
 
22
  #
23
  # Other GGUF sources (use with `make build GGUF_PATH=...`):
24
  # https://huggingface.co/unsloth/Qwen3.6-27B-GGUF
README.md CHANGED
@@ -61,51 +61,33 @@ pipeline_tag: image-text-to-text
61
 
62
  A personal sibling to [`FoolDev/Janus-35B`](https://huggingface.co/FoolDev/Janus-35B). Same teacher (Claude Opus 4.7), same dataset family, but built on the **dense** [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B) base instead of the 35B-A3B MoE. Smaller, easier to deploy, no expert-routing surprises.
63
 
64
- > **Heads up** β€” the bundled GGUF is stamped
65
- > `general.architecture: 'qwen36'`, the architecturally-honest
66
- > label for the Qwen 3.6 family. **No released llama.cpp / Ollama
67
- > recognizes it yet** (`ggml-org/llama.cpp` and `ollama/ollama`
68
- > register the hybrid SSM + attention stack as `qwen35` /
69
- > `qwen35moe`; verified 2026-05-19). A fresh
70
- > `ollama run hf.co/FoolDev/Thanatos-27B` pulls ~17 GB and then
71
- > 500s with `unable to load model: <blob>`. Run `make heal-hf`
72
- > once after the failure to rebadge the cached blob qwen36 β†’
73
- > qwen35 in place β€” subsequent runs load. Or skip the bundle
74
- > entirely with `make build` (qwen35-stamped from unsloth, loads
75
- > on stock Ollama). See [Architecture](#architecture) for the
76
- > stamp history and trade-off.
77
-
78
  ## TL;DR
79
 
80
- Three paths, in increasing order of disk re-use:
 
 
 
81
 
82
  ```bash
83
- # A. Pull from HF (gets the bundled qwen36 GGUF + root-level
84
- # template / system / params files). First `ollama run` 500s
85
- # on the qwen36 blob; `make heal-hf` rebadges it in place.
86
- ollama run hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M, qwen36
87
- git clone https://huggingface.co/FoolDev/Thanatos-27B && cd Thanatos-27B
88
- make heal-hf # rebadge cached blob -> qwen35
89
- ollama run hf.co/FoolDev/Thanatos-27B # now loads
90
 
91
- # B. Build a local `thanatos-27b` tag from THIS repo's bundle
92
- # (smudges the LFS pointer via `hf download`, rebadges
93
- # qwen36 -> qwen35 in a local copy, runs `ollama create`):
94
- git clone https://huggingface.co/FoolDev/Thanatos-27B && cd Thanatos-27B
95
- make load-bundle # creates local tag thanatos-27b
96
- ollama run thanatos-27b
97
 
98
- # C. Bypass the bundle: download a qwen35-stamped GGUF from
99
- # unsloth/Qwen3.6-27B-GGUF and build locally β€” no rebadge
100
- # needed. Loads on every current llama.cpp / Ollama.
101
  git clone https://huggingface.co/FoolDev/Thanatos-27B && cd Thanatos-27B
102
- make build # Q4_K_M -> thanatos-27b
103
  ollama run thanatos-27b
104
  ```
105
 
106
- For other quants (Q3_K_S ~12 GB, Q5_K_M ~20 GB, etc.) path **C**
107
- is simplest: `make build QUANT=Q3_K_S`. See
108
- [Quick start](#quick-start) below for the full matrix.
109
 
110
  For image input use llama.cpp directly β€” Ollama vision is broken for
111
  this architecture upstream (see [Vision](#vision)).
@@ -157,7 +139,7 @@ This repo ships a single GGUF to back the HF/Ollama "Use this model"
157
  widget β€” `Thanatos-27B.Q4_K_M.gguf` (~17 GB, qwen36-stamped):
158
 
159
  ```bash
160
- ollama run hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M, qwen36 β€” fails today, see Heads up above
161
  ```
162
 
163
  For 16 GB GPUs / unified-memory laptops β€” and as a working-today
@@ -194,46 +176,43 @@ If you want the safetensors for `transformers`, fetch them from [`Qwen/Qwen3.6-2
194
  current loader compatibility.
195
  - Multi-token prediction (MTP) head trained for speculative decoding
196
 
197
- **The bundled GGUF declares `general.architecture: 'qwen36'`** β€” the
198
- architecturally-honest label for the Qwen 3.6 family. The cost is
199
- that no released `ggml-org/llama.cpp` or `ollama/ollama` registers
200
- that string yet: both register the hybrid SSM + attention stack as
201
- `qwen35` / `qwen35moe`, including for actual Qwen 3.6-family weights
202
- (the upstream `Qwen3.6-35B-A3B_Q8_0` GGUFs load under `qwen35moe`).
203
- No `qwen36` arch entry exists in either repo, and as of 2026-05-19
204
- there's still no open PR or tracking issue adding one. A
205
- `qwen36`-stamped GGUF therefore fails to load on stock loaders with
206
- `unknown model architecture: 'qwen36'` until the metadata is
207
- rebadged.
208
-
209
- `scripts/rename_arch.py` does the rebadge: a metadata-only flip
210
- that leaves all tensor bytes intact. `make heal-hf` automates it
211
- for an already-pulled `hf.co/FoolDev/Thanatos-27B` tag (rewrites
212
- the blob + the manifest's model-layer digest, idempotent on
213
- already-rebadged tags); `make load-bundle` builds a separate
214
- local `thanatos-27b` tag from a rebadged copy without touching the
215
- HF-bridge manifest. Both produce a tag that loads on stock Ollama:
 
 
 
 
 
 
216
 
217
  ```bash
218
  python3 scripts/rename_arch.py \
219
- --from-arch qwen36 --to-arch qwen35 \
220
  Thanatos-27B.Q4_K_M.gguf \
221
- Thanatos-27B.Q4_K_M.qwen35.gguf
222
  ```
223
 
224
- **History.** The bundle has flipped stamp three times. v0.6.0
225
- shipped `qwen36` (commit `e1f78fa`, architecturally-honest).
226
- Commit `964e418` (2026-05-19) reverted to `qwen35` to stop forcing
227
- the rebadge workaround on every fresh pull. Commit `07fa120`
228
- (same day) flipped it back to `qwen36` β€” restoring the honest
229
- label and accepting that stock Ollama users need one `make
230
- heal-hf` after the first failed run. Tensor data is byte-identical
231
- across all three states; only the `general.architecture` KV (and
232
- namespaced KV keys) flips. The current bundle blob SHA is
233
- `b2b63b941d714b0aff5e9afc9b337e7607b84e371ba991c182d92d0f7805c0e9`,
234
- identical to the original v0.6.0 qwen36 blob β€” content-addressed
235
- return to a known artifact. See the
236
- [CHANGELOG](CHANGELOG.md) entry for the trade-off rationale.
237
 
238
  ## Quick start
239
 
@@ -242,25 +221,18 @@ return to a known artifact. See the
242
  Three paths:
243
 
244
  ```bash
245
- # A. Pull straight from HF (gets the bundled qwen36 Q4_K_M GGUF +
246
- # the root-level template / system / params files in one step).
247
- # The first `ollama run` will 500 on the qwen36 blob β€”
248
- # `make heal-hf` rebadges it in place so the same tag loads.
249
- ollama run hf.co/FoolDev/Thanatos-27B # 17 GB pull, then 500
250
- make heal-hf # rebadge cached blob in store
251
- ollama run hf.co/FoolDev/Thanatos-27B # now loads
252
 
253
  # B. Build a local `thanatos-27b` tag from THIS repo's bundle
254
- # (smudges LFS pointer via `hf download` if needed, rebadges
255
- # qwen36 -> qwen35 in a local copy, runs `ollama create`).
256
- # Useful if you want a bare local tag rather than the
257
- # hf.co/... path:
258
  make load-bundle # creates local tag thanatos-27b
259
  ollama run thanatos-27b
260
 
261
  # C. Bypass the bundle: download a qwen35-stamped GGUF from unsloth
262
- # and build locally. Loads on every current llama.cpp / Ollama
263
- # with no rebadge step.
264
  make build # Q4_K_M -> thanatos-27b
265
  make build QUANT=Q3_K_S # 12 GB smaller quant
266
  make build QUANT=Q5_K_M # 20 GB higher quality
@@ -288,15 +260,14 @@ python examples/ollama_chat.py # full demo: chat, streaming, tools, OpenAI-
288
 
289
  The bundled `Thanatos-27B.Q4_K_M.gguf` is `qwen36`-stamped β€” every row
290
  below assumes you've rebadged it to `qwen35` per
291
- [Architecture](#architecture) (via `make heal-hf` or `make load-bundle`),
292
- or that you're pulling a `qwen35`-stamped GGUF from
293
- `unsloth/Qwen3.6-27B-GGUF` instead. The "fails today with
294
  `unknown model architecture: 'qwen36'`" caveat applies to every row
295
  until that's done.
296
 
297
  | App | How to load this model |
298
  |---|---|
299
- | **Ollama** | `ollama run hf.co/FoolDev/Thanatos-27B` (default Q4_K_M) pulls the GGUF + the root-level `template` / `system` / `params` files in one step (HF's Ollama bridge ingests these three files; it does **not** read `Modelfile`). The first `ollama run` 500s on the qwen36 blob β€” run `make heal-hf` once to rebadge it in place, after which the same tag loads. To skip the rebadge entirely, `make build QUANT=Q4_K_M` (or another quant) downloads a qwen35-stamped GGUF from unsloth and creates a local Ollama tag using the `Modelfile`, which is kept in sync with the bridge files. |
300
  | **LM Studio** | Search β†’ `FoolDev/Thanatos-27B` β†’ pick `Thanatos-27B.Q4_K_M.gguf`. Uses the GGUF's embedded jinja chat template (Qwen 3.6 ChatML); set the system prompt manually from the `SYSTEM` block in this repo's `Modelfile`. |
301
  | **Jan** | Hub β†’ "Import from Hugging Face" β†’ `FoolDev/Thanatos-27B`. Same template behavior as LM Studio. |
302
  | **llama.cpp** | `hf download FoolDev/Thanatos-27B Thanatos-27B.Q4_K_M.gguf --local-dir .` then `llama-server -m Thanatos-27B.Q4_K_M.gguf` (or `llama-cli`, `llama-mtmd-cli` for vision via the upstream `mmproj-F16.gguf`). |
 
61
 
62
  A personal sibling to [`FoolDev/Janus-35B`](https://huggingface.co/FoolDev/Janus-35B). Same teacher (Claude Opus 4.7), same dataset family, but built on the **dense** [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B) base instead of the 35B-A3B MoE. Smaller, easier to deploy, no expert-routing surprises.
63
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64
  ## TL;DR
65
 
66
+ One-liner via Hugging Face (pulls a GGUF + this repo's root-level
67
+ `template` / `system` / `params` files, including the tool-calling
68
+ template β€” HF's Ollama bridge ingests those three files, not
69
+ `Modelfile`):
70
 
71
  ```bash
72
+ ollama run hf.co/FoolDev/Thanatos-27B # ~17 GB Q4_K_M, qwen35-stamped, loads on stock Ollama
73
+ ```
 
 
 
 
 
74
 
75
+ If you pulled the bundle while it was qwen36-stamped (v0.6.0
76
+ through the early hours of 2026-05-19) the load will still 500 on
77
+ that stale blob β€” `make heal-hf` rebadges it in place. Fresh
78
+ pulls after this fix go straight through.
 
 
79
 
80
+ For other quants (Q3_K_S ~12 GB, Q5_K_M ~20 GB, etc.):
81
+
82
+ ```bash
83
  git clone https://huggingface.co/FoolDev/Thanatos-27B && cd Thanatos-27B
84
+ make build QUANT=Q3_K_S # downloads from unsloth/Qwen3.6-27B-GGUF
85
  ollama run thanatos-27b
86
  ```
87
 
88
+ For other quants (Q3_K_S ~12 GB, Q5_K_M ~20 GB, etc.), `make build
89
+ QUANT=Q3_K_S` is the simplest path. See [Quick start](#quick-start)
90
+ below for the full matrix.
91
 
92
  For image input use llama.cpp directly β€” Ollama vision is broken for
93
  this architecture upstream (see [Vision](#vision)).
 
139
  widget β€” `Thanatos-27B.Q4_K_M.gguf` (~17 GB, qwen36-stamped):
140
 
141
  ```bash
142
+ ollama run hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M, qwen36 β€” fails today, see Heads-up above
143
  ```
144
 
145
  For 16 GB GPUs / unified-memory laptops β€” and as a working-today
 
176
  current loader compatibility.
177
  - Multi-token prediction (MTP) head trained for speculative decoding
178
 
179
+ **The bundled GGUF declares `general.architecture: 'qwen35'`** β€” the
180
+ arch entry every released llama.cpp / Ollama loads the Qwen 3.6
181
+ hybrid SSM + attention family under. Upstream `ggml-org/llama.cpp`
182
+ and `ollama/ollama` register the stack as `qwen35` / `qwen35moe`,
183
+ including for actual Qwen 3.6-family weights (the upstream
184
+ `Qwen3.6-35B-A3B_Q8_0` GGUFs load under `qwen35moe`); no `qwen36`
185
+ arch entry exists, and there's no open PR or tracking issue for
186
+ one β€” `qwen35` is the canonical load-time label.
187
+
188
+ `ollama run hf.co/FoolDev/Thanatos-27B` and `llama-server -m
189
+ Thanatos-27B.Q4_K_M.gguf` both load directly on current stock
190
+ loaders.
191
+
192
+ **History.** Through v0.6.0 the bundle was stamped `qwen36` β€” the
193
+ architecturally-honest label, but unloadable on stock loaders.
194
+ Users needed `make load-bundle` or `make heal-hf` to rebadge
195
+ before loading. The stamp was reverted to `qwen35` in commit
196
+ `964e418` to stop forcing the workaround on every fresh pull;
197
+ tensor data was byte-identical across both stamps, only the
198
+ `general.architecture` KV (and namespaced KV keys) flipped. See
199
+ the [CHANGELOG](CHANGELOG.md) entry for the full rationale.
200
+
201
+ `scripts/rename_arch.py` is kept in the repo as a generic GGUF
202
+ arch renamer (metadata only, tensors byte-identical) for future
203
+ flips:
204
 
205
  ```bash
206
  python3 scripts/rename_arch.py \
207
+ --from-arch qwen35 --to-arch qwen36 \
208
  Thanatos-27B.Q4_K_M.gguf \
209
+ Thanatos-27B.Q4_K_M.qwen36.gguf
210
  ```
211
 
212
+ If you pulled the bundle while it was still qwen36-stamped (v0.6.0
213
+ through 2026-05-19) and have the broken blob in your local Ollama
214
+ store, `make heal-hf` rebadges it in place so the same
215
+ `hf.co/...` tag becomes loadable without re-pulling.
 
 
 
 
 
 
 
 
 
216
 
217
  ## Quick start
218
 
 
221
  Three paths:
222
 
223
  ```bash
224
+ # A. Pull straight from HF (gets the bundled Q4_K_M GGUF + the
225
+ # root-level template / system / params files in one step):
226
+ ollama run hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M, qwen35-stamped
 
 
 
 
227
 
228
  # B. Build a local `thanatos-27b` tag from THIS repo's bundle
229
+ # (LFS smudge if needed, then `ollama create`). Useful if you
230
+ # want a bare local tag rather than the `hf.co/...` path:
 
 
231
  make load-bundle # creates local tag thanatos-27b
232
  ollama run thanatos-27b
233
 
234
  # C. Bypass the bundle: download a qwen35-stamped GGUF from unsloth
235
+ # and build locally. Loads on every current llama.cpp / Ollama.
 
236
  make build # Q4_K_M -> thanatos-27b
237
  make build QUANT=Q3_K_S # 12 GB smaller quant
238
  make build QUANT=Q5_K_M # 20 GB higher quality
 
260
 
261
  The bundled `Thanatos-27B.Q4_K_M.gguf` is `qwen36`-stamped β€” every row
262
  below assumes you've rebadged it to `qwen35` per
263
+ [Architecture](#architecture), or that you're pulling a `qwen35`-stamped
264
+ GGUF from `unsloth/Qwen3.6-27B-GGUF` instead. The "fails today with
 
265
  `unknown model architecture: 'qwen36'`" caveat applies to every row
266
  until that's done.
267
 
268
  | App | How to load this model |
269
  |---|---|
270
+ | **Ollama** | `ollama run hf.co/FoolDev/Thanatos-27B` (default Q4_K_M). Pulls the GGUF + the root-level `template` / `system` / `params` files in one step (HF's Ollama bridge ingests these three files; it does **not** read `Modelfile`). For other quants, or to bypass the qwen36 block today, `make build QUANT=Q3_K_S` downloads from unsloth (qwen35-stamped) and creates a local Ollama tag using the `Modelfile`, which is kept in sync with the bridge files. |
271
  | **LM Studio** | Search β†’ `FoolDev/Thanatos-27B` β†’ pick `Thanatos-27B.Q4_K_M.gguf`. Uses the GGUF's embedded jinja chat template (Qwen 3.6 ChatML); set the system prompt manually from the `SYSTEM` block in this repo's `Modelfile`. |
272
  | **Jan** | Hub β†’ "Import from Hugging Face" β†’ `FoolDev/Thanatos-27B`. Same template behavior as LM Studio. |
273
  | **llama.cpp** | `hf download FoolDev/Thanatos-27B Thanatos-27B.Q4_K_M.gguf --local-dir .` then `llama-server -m Thanatos-27B.Q4_K_M.gguf` (or `llama-cli`, `llama-mtmd-cli` for vision via the upstream `mmproj-F16.gguf`). |
examples/README.md CHANGED
@@ -19,26 +19,24 @@ from the `Modelfile` / bridge files.
19
 
20
  ### Ollama
21
 
22
- The bundle is stamped `general.architecture: 'qwen36'` and no
23
- released llama.cpp / Ollama recognizes that string yet (both
24
- register the Qwen 3.6 stack as `qwen35` / `qwen35moe` β€” see
25
- [../README.md#architecture](../README.md#architecture)). The first
26
- `ollama run` against the HF-bridge tag pulls 17 GB and then 500s
27
- with `unable to load model: <blob>`. Run `make heal-hf` once
28
- after the failure to rebadge the cached blob in place β€” the same
29
- tag loads on subsequent runs:
30
 
31
  ```bash
32
  ollama pull hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M (only bundled quant)
33
- cd .. && make heal-hf && cd examples # rebadge cached blob qwen36 -> qwen35
34
  pip install requests
35
  MODEL=hf.co/FoolDev/Thanatos-27B python ollama_chat.py
36
  ```
37
 
38
- For a non-bundled quant (e.g. Q3_K_S ~12 GB, Q5_K_M ~20 GB) β€” or
39
- to skip the rebadge entirely β€” `make build QUANT=...` downloads
40
- a qwen35-stamped GGUF from `unsloth/Qwen3.6-27B-GGUF` and creates
41
- a local `thanatos-27b` tag:
 
 
 
 
42
 
43
  ```bash
44
  cd .. && make build QUANT=Q3_K_S && cd examples
 
19
 
20
  ### Ollama
21
 
22
+ Pull straight from HF (gets the bundled Q4_K_M GGUF + this repo's
23
+ root-level `template` / `system` / `params` files via HF's Ollama
24
+ bridge):
 
 
 
 
 
25
 
26
  ```bash
27
  ollama pull hf.co/FoolDev/Thanatos-27B # 17 GB Q4_K_M (only bundled quant)
 
28
  pip install requests
29
  MODEL=hf.co/FoolDev/Thanatos-27B python ollama_chat.py
30
  ```
31
 
32
+ If you pulled before commit `964e418` (the qwen35 re-stamp) and
33
+ still have the broken qwen36 blob in your Ollama store, run
34
+ `cd .. && make heal-hf` once to rebadge it in place. Fresh pulls
35
+ after the re-stamp go straight through.
36
+
37
+ For a non-bundled quant (e.g. Q3_K_S ~12 GB, Q5_K_M ~20 GB),
38
+ `make build QUANT=...` downloads from `unsloth/Qwen3.6-27B-GGUF`
39
+ and creates a local `thanatos-27b` tag:
40
 
41
  ```bash
42
  cd .. && make build QUANT=Q3_K_S && cd examples