Instructions to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Use Docker
docker model run hf.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
- Ollama
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Ollama:
ollama run hf.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
- Unsloth Studio
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF to start chatting
- Pi
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Docker Model Runner:
docker model run hf.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
- Lemonade
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
TWO 40B models ; now available - Will there be a 40B version? [versions in testing]
I'm looking forward to the 40B version. It works fine right now, but it still feels like something is missing—I wonder if there will be a "40B711" release?
Testing the prototypes today.
There are a lot of additional steps required to get these to 700+; as there is a drop off (known issue) at the expansion step.
This issue must be addressed post expansion.
IT begins:
https://huggingface.co/DavidAU/Qwen3.6-40B-Grand-Intelligence-One
Composed of TWO 700+ ARC-C Monsters.
In testing.
Full example generation on the repo test page.
This is a take no prisoners version.
Sample:
"Listen up, you trembling little scribe with the sticky fingers and the big dreams. You’re standing there, staring at a blank page like a deer caught in the headlights of a freight train made of your own inadequacy, wondering who you’re going to beg to help you craft your masterpiece? You’re thinking about writing it yourself? You’re thinking about hiring some pretentious hack who charges by the word and cries when you ask him to cut his precious exposition? Or worse—hell, worse than worse—you’re thinking about using one of those soulless, sanitized, corporate-approved AI bots that write like they’re afraid to sneeze on a nun?"
...
Update:
Alpha "tune" part one complete; proceeding on testing other alphas / 2nd/3rd level tuning.
Due to issues caused by expansion, the model requires re-tuning to regain "711" type performance/benches.
Benches of expanded [non tuned] and [light / stage tune[s]] are here:
https://huggingface.co/DavidAU/Qwen3.6-40B-Grand-Intelligence-One-IQ-tune-alpha
NOTE: THIS IS A WORK IN PROGRESS ; it will take time to get it right.
NOTE: Name of the REPO for "alpha" will CHANGE as the project proceeds.
Update;
One alpha 40B has reached "700 club" status. Work continues.
this is super cool! i applied to access your gated model, have you released it in gguf form yet? regardless, i am curious as to how the performance is on my 128gb vram system i just finished building out!
@cpui686
Thank you ;
40B model build is in progress, however this build has more steps than 27B due in part to expansion and extended testing.
Benching 40Bs take twice a long too, per test.
As of this writing there will likely be at least 2 versions, maybe more - a general version plus specific/specialized use case(s).
aaah i see, yea that makes a lot of sense! keep up the good work!
Update;
Alpha testing finishing up ; Beta testing/tuning about to start.
Onward.
Hello,
Will it be a MOE?
Otherwise, something planned like "Qwen3.6-35B-A3B Fable-Fusion-711"?
I'm really hoping the 40B model is like, significantly better at coding than the 27B; do you think it will be? Just trying to get general vibes 😃
Thank you so much for all your hard work!
Amazing, you never fail to get people excited. Keep up the good work, but also take care of yourself :)
There’s some good news: the new 27B (3.8) version is reportedly set for release next week.
DavidAU, perhaps the new 40B model—which promises higher scores, faster speeds, and greater intelligence—will prove superior for your training; August is shaping up to be a truly wonderful month.
We are waiting for 3.8 too ; the pipeline is ready ;
40B version has entered BETA testing, in the "FF711" pipeline.
I would like to throw my observations -> the 27B model is really amazing at digesting a 350k text draft of a novel, distilling the magic system into a markdown, then finding reader confusion within the system. Truly remarkable in a model I never thought possible to run on my local machine. Thank you so much. I have one question: does the model do any token watermarking (not from you, but from Qwen)? I read that Google's SynthID can be marked on text output tokens this week, so now I'm just suspicious of all of these models that they can "fingerprint" your text!
Thank you for the detailed feedback ; excellent.
RE: Watermark;
I don't put any water marks per say in my fine tunes.
I don't know if Qwen does ;
Other issues: The AI app(s) you use ; I don't know any that do so , so far.
TWO 40B models now in limited release ; GGUFS uploading first (in progress - regular and MTP GGUFS; followed by full source release.
Both 40B models have ggufs available right now.
Fable Fusion Family
The Fable Fusion family consists of (in order):
Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic
This is a project "test pilot" for building the Fable Fusion 27B/40B models.
GGUFS:
https://huggingface.co/DavidAU/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF
SOURCE:
https://huggingface.co/DavidAU/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP
Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic
1700+ likes, 2.3 million+ downloads, universal acclaim and 3rd party verications of performance.
GGUFS and many other quant types:
https://huggingface.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF
SOURCE:
https://huggingface.co/DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP
Qwen3.6-40B-Grand-Intelligence-Fable-Fusion-Uncensored-Heretic
Built from multiple versions of Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic (and related 717), expanded and tuned.
GGUFS:
https://huggingface.co/DavidAU/Qwen3.6-40B-Grand-Intelligence-Fable-Fusion-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF
SOURCE:
https://huggingface.co/DavidAU/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored
Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored
Built from multiple versions of Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic (and related 717), expanded and tuned,
and Qwen3.6-40B-Grand-Intelligence-Fable-Fusion-Uncensored-Heretic then fused with THE DECKARD 40B.
GGUFS:
https://huggingface.co/DavidAU/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored-NM-DAU-NEO-MAX-MTP-GGUF
SOURCE:
https://huggingface.co/DavidAU/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored
Update: (repeating across all 3.8 threads || Primary "Update" thread.)
Currently we are testing Qwen 3.8 27B to get core metrics and primary "human testing" to get a sense of model's
character /stats / issue(s) as well as how it compares to base Qwen 3.6 27B, Qwen 3.6 27B Fable Fusion 711 and other lab versions of "711".
As of this writing we know the pipeline is compatible with this model, as well as the new GAIN training method (AKA "COLD FUSION")
which was invented during the build of Qwen 3.6 27B Fable Fusion 711.
Fable Fusion 711 used a primitive (but effective) version of GAIN during the build process. COLD FUSION takes this to the next level
with the ability to maintain BF16 metrics across 8 bit and 4 bit at 99% (of BF16/full precision) as of this writing.
The first test model (built 14 days ago) has been released here:
https://huggingface.co/DavidAU/Qwen3.5-9B-Cold-Fusion-GAIN-v1.0-Uncensored-Heretic-NEO-MAX-Imatrix-GGUF
With Qwen 3.6 Fable Fusion "Darker Hero" (built 3 days ago) also using COLD FUSION here (ggufs/source releasing shortly):
https://huggingface.co/DavidAU/Qwen3.6-27B-V1.1-FF711-Darker-Hero-GAIN-H2.0
NOTE:
- This version has been "re-heretic'ed", and trained to reduce thinking down to 1/10 to 1/2 "qwen size".
- 3 example generations.
We published both "reg training" and "GAIN training" benches (at both 9B and 27B repos above) so you can see the differences.
They are stark.
With Qwen 3.8 27B we will shortly be testing it in the pipeline and/or using COLD FUSION on it.
Conversely GAIN will also be used on current Qwen 3.6 models, and other arch/model types.
This is a lengthy, intense and detailed process so it may take some time before we publish.
Thank you ;
This August has been non-stop—from the 27B-711 to the new 40B, and now the new 3.8 27B. David, please make sure to get some rest; I’m finding myself sleep-deprived just from using your models! Yet, I’m also eagerly looking forward to your next update—it’s quite a dilemma. Keep up the great work!
take care of yourself