Instructions to use artindnr/Strawberry-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use artindnr/Strawberry-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf artindnr/Strawberry-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf artindnr/Strawberry-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf artindnr/Strawberry-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf artindnr/Strawberry-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf artindnr/Strawberry-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf artindnr/Strawberry-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf artindnr/Strawberry-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf artindnr/Strawberry-GGUF:Q4_K_M
Use Docker
docker model run hf.co/artindnr/Strawberry-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use artindnr/Strawberry-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "artindnr/Strawberry-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "artindnr/Strawberry-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/artindnr/Strawberry-GGUF:Q4_K_M
- Ollama
How to use artindnr/Strawberry-GGUF with Ollama:
ollama run hf.co/artindnr/Strawberry-GGUF:Q4_K_M
- Unsloth Studio
How to use artindnr/Strawberry-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for artindnr/Strawberry-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for artindnr/Strawberry-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for artindnr/Strawberry-GGUF to start chatting
- Pi
How to use artindnr/Strawberry-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf artindnr/Strawberry-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "artindnr/Strawberry-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use artindnr/Strawberry-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf artindnr/Strawberry-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "artindnr/Strawberry-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use artindnr/Strawberry-GGUF with Docker Model Runner:
docker model run hf.co/artindnr/Strawberry-GGUF:Q4_K_M
- Lemonade
How to use artindnr/Strawberry-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull artindnr/Strawberry-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Strawberry-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use artindnr/Strawberry-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf artindnr/Strawberry-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default artindnr/Strawberry-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
π Strawberry GGUF
Strawberry GGUF is a collection of quantized GGUF versions of artindnr/strawberry, a fine-tuned version of openai/gpt-oss-20b specialized for Farsi (Persian) reasoning traces and multilingual chain-of-thought generation.
These files are optimized for efficient local inference using llama.cpp, LM Studio, KoboldCpp, and other GGUF-compatible inference engines.
Model Details
- Model name: Strawberry
- Original base model:
openai/gpt-oss-20b - Fine-tuned model:
artindnr/strawberry-1 - Architecture:
gpt_oss - Parameters: ~21B
- Format: GGUF
- Quantization: Multiple GGUF quantization variants
- Fine-tuned by:
artindnr - License: Apache 2.0
- Languages: Farsi (Persian), English, multilingual reasoning
About Strawberry-1
Strawberry is a fine-tuned version of openai/gpt-oss-20b designed to improve multilingual reasoning capabilities, with a particular focus on native Farsi reasoning traces.
Most reasoning models generate their internal reasoning primarily in English, even when answering in another language. Strawberry-1 was trained to:
- Generate coherent reasoning traces in Farsi
- Reason across multiple languages
- Preserve strong instruction-following ability
- Maintain general reasoning capabilities from the GPT-OSS base model
The model supports both:
- Farsi reasoning
- English reasoning
- Multilingual reasoning workflows
Training
Strawberry was trained using a combination of full fine-tuning and LoRA experiments on top of openai/gpt-oss-20b.
The released model is a merged dense-weight checkpoint before conversion into GGUF format.
Training Data
Strawberry was trained using the Thinking Datasets collection:
artindnr/Persian-Thinking
Farsi reasoning traces.artindnr/Persian-English-Thinking
Mixed Farsi and English reasoning traces.artindnr/Multilingual-Thinking
Multilingual chain-of-thought reasoning.artindnr/Multilingual-Thinking-200
A smaller multilingual reasoning subset.
GGUF Format
GGUF is a format designed for efficient local inference.
These files can be used with:
- llama.cpp
- LM Studio
- KoboldCpp
- text-generation-webui
- Ollama-compatible runtimes
- Other GGUF-supported applications
GGUF provides:
- Reduced memory usage
- Faster local inference
- CPU and GPU acceleration support
- Quantized model execution without requiring the original framework
Available Quantizations
| Quantization | Size |
|---|---|
| Q2_K | 12.1 GB |
| Q3_K_S | 12.1 GB |
| Q3_K_M | 12.9 GB |
| Q3_K_L | 13.3 GB |
| IQ4_XS | 12.2 GB |
| Q4_K_S | 14.7 GB |
| MXFP4_MOE | 12.1 GB |
| Q4_K_M | 15.8 GB |
| Q5_K_S | 15.9 GB |
| Q5_K_M | 16.9 GB |
| Q6_K | 22.2 GB |
| Q8_0 | 22.3 GB |
Recommended Quantizations
β Best Overall Balance
MXFP4_MOE
Recommended for most users.
This quantization is designed specifically for Mixture-of-Experts models and provides a strong balance between:
- Memory usage
- Inference speed
- Model quality
Highest Quality
Q8_0
Q6_K
Recommended when you have enough RAM or VRAM.
These preserve more information from the original model weights and generally provide the closest quality to the original BF16 model.
Smaller Memory Usage
Q2_K
Q3_K_M
IQ4_XS
Useful for:
- Smaller systems
- Limited VRAM environments
- CPU inference
Lower-bit quantizations reduce memory requirements but may slightly reduce reasoning quality.
Usage
llama.cpp
Install llama.cpp:
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
cmake -B build
cmake --build build --config Release
Run Strawberry-1:
./llama-cli \
-m strawberry-1-MXFP4_MOE.gguf \
-p "ΨͺΩ Ϊ©Ϋ ΩΨ³ΨͺΫΨ" \
-n 512
Chat Template
Strawberry uses the GPT-OSS Harmony chat format.
GGUF files contain the required metadata for compatible runtimes to automatically apply the correct chat template.
The model supports reasoning language control through the system prompt.
Example:
reasoning language: Farsi
or:
reasoning language: English
Example Prompt
<system>
reasoning language: Farsi
</system>
<user>
ΪΨ±Ψ§ Ψ’Ψ³Ω
Ψ§Ω Ψ’Ψ¨Ϋ Ψ§Ψ³ΨͺΨ
</user>
The model will generate responses following the GPT-OSS Harmony format, including reasoning and final response channels.
Hardware Requirements
Approximate memory requirements:
| Quantization | Recommended Memory |
|---|---|
| Q2_K | ~16 GB |
| Q3_K_M | ~16 GB |
| IQ4_XS | ~16 GB |
| MXFP4_MOE | ~16 GB |
| Q4_K_M | ~20 GB |
| Q5_K_M | ~24 GB |
| Q6_K | ~28 GB |
| Q8_0 | ~32 GB |
Actual requirements depend on:
- Context length
- Runtime overhead
- GPU offloading settings
- Batch size
Intended Use
Strawberry-1 GGUF is intended for:
- Local AI assistants
- Farsi-language applications
- Multilingual reasoning research
- Offline inference
- Educational tools
- Experimentation with reasoning models
Limitations
- Quantization can slightly reduce reasoning quality compared to the original BF16 model.
- Lower-bit quantizations trade accuracy for reduced memory usage.
- The model may occasionally produce incorrect information or hallucinations.
- Farsi reasoning quality may vary depending on the complexity of the task.
- This model inherits limitations from the original GPT-OSS architecture.
License
Strawberry GGUF is released under the Apache 2.0 license, consistent with the original model license.
Credits
Built on top of:
GGUF conversion and quantization were performed to enable efficient local inference.
Citation
If you use Strawberry in your work, please cite:
@misc{strawberry,
title = {Strawberry: A Farsi and Multilingual Reasoning Model Fine-tuned from GPT-OSS-20B},
author = {artindnr},
year = {2026},
url = {https://huggingface.co/artindnr/strawberry}
}
- Downloads last month
- -
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit