Instructions to use VertexAIco/prism-creative-1-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use VertexAIco/prism-creative-1-mini with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("VertexAIco/prism-creative-1-mini") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use VertexAIco/prism-creative-1-mini with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf VertexAIco/prism-creative-1-mini:Q4_K_M # Run inference directly in the terminal: llama cli -hf VertexAIco/prism-creative-1-mini:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf VertexAIco/prism-creative-1-mini:Q4_K_M # Run inference directly in the terminal: llama cli -hf VertexAIco/prism-creative-1-mini:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf VertexAIco/prism-creative-1-mini:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf VertexAIco/prism-creative-1-mini:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf VertexAIco/prism-creative-1-mini:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf VertexAIco/prism-creative-1-mini:Q4_K_M
Use Docker
docker model run hf.co/VertexAIco/prism-creative-1-mini:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use VertexAIco/prism-creative-1-mini with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "VertexAIco/prism-creative-1-mini" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "VertexAIco/prism-creative-1-mini", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/VertexAIco/prism-creative-1-mini:Q4_K_M
- Ollama
How to use VertexAIco/prism-creative-1-mini with Ollama:
ollama run hf.co/VertexAIco/prism-creative-1-mini:Q4_K_M
- Unsloth Studio
How to use VertexAIco/prism-creative-1-mini with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for VertexAIco/prism-creative-1-mini to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for VertexAIco/prism-creative-1-mini to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for VertexAIco/prism-creative-1-mini to start chatting
- Pi
How to use VertexAIco/prism-creative-1-mini with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "VertexAIco/prism-creative-1-mini"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "VertexAIco/prism-creative-1-mini" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use VertexAIco/prism-creative-1-mini with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "VertexAIco/prism-creative-1-mini"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "VertexAIco/prism-creative-1-mini" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "VertexAIco/prism-creative-1-mini", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use VertexAIco/prism-creative-1-mini with Docker Model Runner:
docker model run hf.co/VertexAIco/prism-creative-1-mini:Q4_K_M
- Lemonade
How to use VertexAIco/prism-creative-1-mini with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull VertexAIco/prism-creative-1-mini:Q4_K_M
Run and chat with the model
lemonade run user.prism-creative-1-mini-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use VertexAIco/prism-creative-1-mini with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "VertexAIco/prism-creative-1-mini"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default VertexAIco/prism-creative-1-mini
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use VertexAIco/prism-creative-1-mini with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "VertexAIco/prism-creative-1-mini"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "VertexAIco/prism-creative-1-mini" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Overview
Prism Creative 1 Mini is a compact creative-writing and storytelling model, fine-tuned via LoRA on Qwen3-4B-Instruct using a distilled dataset generated by GLM 5.2. It's built to write across genres, forms, and tones — short stories, character sketches, poetry, dialogue scenes, worldbuilding passages, flash fiction, and more — while staying immersive and avoiding the flat, generic "AI assistant" register.
Part of the Prism family of creative and roleplay models.
Training
- Base model:
mlx-community/Qwen3-4B-Instruct-2507-4bit - Teacher model: GLM 5.2 (via NVIDIA NIM)
- Dataset: 2,500 examples across 10 categories — short stories, character sketches, opening lines, dialogue scenes, worldbuilding, poetry, genre blends, POV exercises, flash fiction, and continuations
- Method: LoRA fine-tuning (rank 8, 16 layers), 6,500 iterations
- Best validation loss: 1.064
Data quality
The training data went through two hardening passes after an initial run surfaced two failure modes: a tendency to loop/repeat on very short fixed-length forms (like 100-word drabbles), and an over-reliance on a handful of "safe" cliché details (e.g. a clock reading a specific time) across otherwise-unrelated prompts. Both the generation prompt and an automated filter (rejecting outputs with excessive 4-gram repetition or flagged cliché phrases) were tightened before the final dataset was generated, and the existing data was re-filtered to match.
Evaluation
A held-out sanity check across flash fiction, worldbuilding, poetry, and dialogue produced coherent, well-formed, in-genre output with no leaked planning text and no repetition loops. Example (flash fiction, mystery noir, 100-word constraint):
Rain slicked the city like oil. I found her in the alley behind the pawn shop, fingers curled around a rusted key. "You knew," she whispered, eyes hollow...
Formats available
This repo includes both:
| Format | File | Notes |
|---|---|---|
| MLX (4-bit) | model.safetensors + config |
For Apple Silicon via mlx-lm |
| GGUF (Q4_K_M) | prism_creative_1_mini_Q4_K_M.gguf |
For llama.cpp and compatible runtimes (LM Studio, Ollama, etc.) |
Usage — MLX
from mlx_lm import load, generate
model, tokenizer = load("VertexAIco/prism-creative-1-mini")
prompt = "Write a short story opening about a lighthouse keeper who receives a letter from someone who shouldn't exist."
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
response = generate(model, tokenizer, prompt=text, max_tokens=400)
print(response)
Usage — GGUF (llama.cpp)
llama-cli -hf VertexAIco/prism-creative-1-mini -m prism_creative_1_mini_Q4_K_M.gguf -p "Write a short story opening about a lighthouse keeper who receives a letter from someone who shouldn't exist."
System prompt
For best results, use the system prompt the model was trained with:
You are a skilled creative writer capable of working across genres, forms, and tones. Follow the given writing prompt precisely -- respect any length, format, and style constraints exactly. Write only the requested creative piece: no preamble, no meta-commentary about your approach, no "Here's a story about..." framing. Begin directly with the piece itself.
Limitations
This is a 4B-parameter model fine-tuned via LoRA on a moderately sized (2,500-example) dataset — it's capable but not infallible. It can still occasionally repeat itself on very constrained short forms, and like any distilled model it inherits some of its teacher's stylistic tendencies. Treat outputs as a strong first draft, not a final one.
License
Apache 2.0, inherited from the Qwen3 base model.
- Downloads last month
- 269
4-bit
Model tree for VertexAIco/prism-creative-1-mini
Base model
Qwen/Qwen3-4B-Instruct-2507