Instructions to use SadikNawazAI/sadik-ai-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SadikNawazAI/sadik-ai-model with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M # Run inference directly in the terminal: llama cli -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M # Run inference directly in the terminal: llama cli -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Use Docker
docker model run hf.co/SadikNawazAI/sadik-ai-model:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use SadikNawazAI/sadik-ai-model with Ollama:
ollama run hf.co/SadikNawazAI/sadik-ai-model:Q4_K_M
- Unsloth Desktop
- Pi
How to use SadikNawazAI/sadik-ai-model with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SadikNawazAI/sadik-ai-model:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use SadikNawazAI/sadik-ai-model with Docker Model Runner:
docker model run hf.co/SadikNawazAI/sadik-ai-model:Q4_K_M
- Lemonade
How to use SadikNawazAI/sadik-ai-model with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SadikNawazAI/sadik-ai-model:Q4_K_M
Run and chat with the model
lemonade run user.sadik-ai-model-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use SadikNawazAI/sadik-ai-model with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SadikNawazAI/sadik-ai-model:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use SadikNawazAI/sadik-ai-model with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SadikNawazAI/sadik-ai-model:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "SadikNawazAI/sadik-ai-model:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
🤖 SADIK AI
Intelligent · Multilingual · Runs Everywhere
Built with passion by Sadik Nawaz (Age 11, Class 6) 🚀
🚀 Run SADIK AI — Pick Your Method!
⚡ Method 1: Ollama (Easiest — 1 command!)
# Install Ollama from https://ollama.com, then:
ollama run hf.co/SadikNawazAI/sadik-ai-model
🐳 Method 2: Docker (One click deploy!)
# Clone/download this repo, then:
docker compose up
# Chat UI opens at: http://localhost:3000
# API runs at: http://localhost:11434
Uses Open WebUI — beautiful browser chat interface!
📦 Method 3: GGUF — LM Studio / Jan.ai / GPT4All
- Download
sadik-ai-q4_k_m.gguffrom this repo (2.5 GB) - Open your app and load the file:
| App | How to load |
|---|---|
| LM Studio | My Models → Load → select .gguf |
| Jan.ai | Hub → Import → select .gguf |
| GPT4All | Models → Add → select .gguf |
| Ollama | ollama run hf.co/SadikNawazAI/sadik-ai-model |
📓 Method 4: Google Colab (Free GPU!)
Open SADIK_AI_Colab.ipynb from this repo → Run all cells!
🔌 Method 5: OpenAI-Compatible API (For Developers)
Works with any app that supports OpenAI API (VS Code, Cursor, SillyTavern, etc.)
# Install requirements
pip install fastapi uvicorn ollama
# Start the API server
python api_server.py
# API runs at: http://localhost:8000/v1
# Set this as your OpenAI base URL in any app!
Use from Python:
from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="sadik")
response = client.chat.completions.create(
model="sadik-ai",
messages=[{"role": "user", "content": "Who are you?"}]
)
print(response.choices[0].message.content)
🐍 Method 6: Pure Python
pip install ollama
ollama pull hf.co/SadikNawazAI/sadik-ai-model
python inference.py
🌐 Supported Languages
| Language | Say hello! |
|---|---|
| 🇬🇧 English | "Who are you?" |
| 🇮🇳 Hindi | "आप कौन हैं?" |
| 🇵🇰 Hinglish | "Aap kaun ho bhai?" |
| 🇯🇵 Japanese | "あなたは誰ですか?" |
| 🇨🇳 Chinese | "你是谁?" |
| 🇩🇪 German | "Wer bist du?" |
📊 Model Details
| Property | Value |
|---|---|
| Base Model | Qwen3.5:4b (GGUF Q4_K_M) |
| File Size | 2.5 GB |
| Context | 4096 tokens |
| Temperature | 0.7 |
| Languages | 6+ |
| Creator | Sadik Nawaz (Age 11) |
| License | Apache 2.0 |
👨💻 About the Creator
Sadik Nawaz — 11 years old, Class 6 student from Pakistan 🇵🇰
"I love building AI things. SADIK AI is my own AI that I built myself!"
📄 Files in This Repo
| File | Purpose |
|---|---|
sadik-ai-q4_k_m.gguf |
The AI model (download & use anywhere) |
Modelfile |
Ollama setup file |
Dockerfile |
Docker container setup |
docker-compose.yml |
Docker Compose (Ollama + WebUI) |
api_server.py |
OpenAI-compatible API server |
inference.py |
Python chat script |
SADIK_AI_Colab.ipynb |
Google Colab notebook |
Run it anywhere. Use it in any language. Yours forever.
- Downloads last month
- -
4-bit