pawanpaudel93/cascadia-clef-flash

Clef-flash decision tree (OpenVINO int8, 1 stage)

A ready-made Cascadia decision tree for Cloudflare/clef-flash, so you can serve /v1/decisions (OpenAI Decisions format) and /v1/systemone without running the exporter yourself.

Clef-flash's full fine-tune weights swapped into Intel's int8 Qwen3.5-9B IR, plus Clef's joint schema head as an OpenVINO model under decision/. It is a 1-stage tree for a single box (about 10.7 GB), the exporter's default.

Preset

Preset	Path	Stages	Layers	Size
1	int8/stages-1	1	32	11.5 GB

int8/stages-1/
  manifest.json  decision.json           # stage split, decision config
  config.json  generation_config.json    # model config
  tokenizer.json  chat_template.jinja    # tokenizer, chat template
  openvino_text_embeddings_model.*       # token embeddings (rank 0)
  decision/                              # pointer head
  stage0/                                # each: stage.xml/.bin

cascadia.json at the repo root is the machine-readable index Cascadia's model registry reads. This repo's weights are byte-identical to pawanpaudel93/clef-flash-int8-ov-decision, which keeps the same tree at its root.

Serve it

hf download pawanpaudel93/cascadia-clef-flash --local-dir ~/trees/cascadia-clef-flash
cascadia run ~/trees/cascadia-clef-flash/int8/stages-1 --engine qwen35 --device GPU --api 127.0.0.1:8080

Use OpenVINO GenAI 2026.4.1 (2026.4.0's GPU plugin has an access violation under long generations). --device CPU works with the same files. See docs/DECISIONS.md in the Cascadia repo for the request formats and limits.

How it was made

Exported with tools/decision_export.py from labscommunity/cascadia branch pawan/decisions-api (commit 94cfdf9b; the exporter's output is unchanged at the PR head db44d59d), from the upstream files downloaded as docs/DECISIONS.md describes:

python tools/decision_export.py clef --base-ir ~/models/qwen35-9b-int8 --weights ~/models/clef-flash --clef-dir ~/models/clef-flash --out ~/trees/clef-flash-int8-t58

Measured

Intel Core Ultra 7 258V (Arc 140V iGPU, 32 GB), Windows 11, OpenVINO GenAI 2026.4.1, --device GPU, Cascadia at db44d59d, against the streamed fp32 reference (50 records / 82 questions):

Check	Result
Parity vs fp32	82/82 PASS, max
/v1/decisions vs /v1/systemone	62/62 identical
Temperature-0 chat before vs after the decision run	byte-identical

License and credits

Apache-2.0, as are all the inputs:

• Fine-tune: Cloudflare/clef-flash (Apache-2.0).
• Base: OpenVINO/Qwen3.5-9B-int8-ov (Intel's int8 IR of Qwen3.5-9B, Apache-2.0), from Qwen (Apache-2.0).
• Conversion: Cascadia (Apache-2.0).

This repository redistributes converted weights only; it adds no training. The full license text is in LICENSE.