Instructions to use Dxniz/Novelist1.0-27b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Dxniz/Novelist1.0-27b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Dxniz/Novelist1.0-27b") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Dxniz/Novelist1.0-27b") model = AutoModelForMultimodalLM.from_pretrained("Dxniz/Novelist1.0-27b", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Dxniz/Novelist1.0-27b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Dxniz/Novelist1.0-27b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Dxniz/Novelist1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Dxniz/Novelist1.0-27b
- SGLang
How to use Dxniz/Novelist1.0-27b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Dxniz/Novelist1.0-27b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Dxniz/Novelist1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Dxniz/Novelist1.0-27b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Dxniz/Novelist1.0-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Dxniz/Novelist1.0-27b with Docker Model Runner:
docker model run hf.co/Dxniz/Novelist1.0-27b
Novelist1.0-27b
A 27B literary writer on Qwen/Qwen3.8-27B. Merged 16-bit weights for roleplay and fiction in English and Turkish.
LoRA (same generation): Dxniz/Novelist1.0-27b-Adapter.
Eval prompts: Dxniz/Novelist-Bench.
Character
Novelist1.0 is trained to stay in the scene: concrete sensory detail, character voice, and the request on the page — not a helper that summarizes, moralizes, or turns the story into a list of themes.
- Voice lock. Holds persona, diction, and POV instead of sliding into generic chatbot prose.
- Scene over slogan. Prefers objects, weather, gesture, and dialogue to abstract feeling and stock metaphors.
- Length as a contract. If you ask for a word count or a range (
800 words,1000 kelime,800–1200), it treats that as part of the task, not decoration. - User text is canon. Does not “correct” or overwrite what the user already established in the prompt.
- Anti-slop. Pushes back on cliché loops, repeated cadence, and empty intensifiers that pad a paragraph without moving the scene.
It is a writer, not an assistant. Weak on tools, code, and factual Q&A; that is by design.
How to prompt it
Give situation + constraint, not a vibe:
- Who is speaking, where, what must happen (or must not).
- Length, tense, POV, and what to leave unsaid.
- Optional: a quota (
Write 600 words./En az 800 en fazla 1200 kelime.).
Sampling (Qwen3.8)
Instruct (recommended for stories) - thinking off:
temperature 0.7 · top_p 0.80 · top_k 20 · min_p 0 · presence_penalty 1.5 · repetition_penalty 1.0 · enable_thinking=false
Thinking - if you want a plan before the prose:
temperature 1.0 · top_p 0.95 · top_k 20 · min_p 0 · presence_penalty 0 · repetition_penalty 1.0 · enable_thinking=true
Training itself used thinking off. Instruct mode is the default product setting.
Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "Dxniz/Novelist1.0-27b"
tok = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_id, torch_dtype="bfloat16", device_map="auto", trust_remote_code=True
)
messages = [
{"role": "system", "content": "You are a literary fiction writer. Follow the prompt exactly."},
{"role": "user", "content": "Write 400 words. Night, a closed bookstore in Istanbul, rain. One argument that does not resolve. No summary at the end."},
]
text = tok.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True, enable_thinking=False
)
inputs = tok(text, return_tensors="pt").to(model.device)
out = model.generate(
**inputs,
max_new_tokens=2048,
temperature=0.7,
top_p=0.8,
top_k=20,
presence_penalty=1.5,
)
print(tok.decode(out[0][inputs.input_ids.shape[-1]:], skip_special_tokens=True))
On the chat call, set chat_template_kwargs={"enable_thinking": false} unless you explicitly want thinking. On 32 GB cards use FP8 or a 4-bit quant of this merge.
Recipe (short)
LoRA r=64 / α=64 on attention and MLP projections, then SFT on roleplay/fiction chats and GRPO with rewards for length/quota, craft, anti-slop, anti-repetition, and not overwriting the user. Sequence-level GRPO (GSPO / dr_grpo).
Limits
Still a language model: it can flatten a character, echo a cliché, or miss a quota on a messy prompt. It will invent facts. Do not use it for medical, legal, or safety-critical advice. Qwen3.8 hybrid stack wants a recent runtime (vLLM 0.27+).
License
Apache 2.0. Also respect the Qwen3.8-27B terms.
- Downloads last month
- 3
Model tree for Dxniz/Novelist1.0-27b
Base model
Qwen/Qwen3.8-27B