Instructions to use kodetr/chatnusa-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use kodetr/chatnusa-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf kodetr/chatnusa-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf kodetr/chatnusa-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf kodetr/chatnusa-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf kodetr/chatnusa-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf kodetr/chatnusa-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf kodetr/chatnusa-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf kodetr/chatnusa-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf kodetr/chatnusa-gguf:Q4_K_M
Use Docker
docker model run hf.co/kodetr/chatnusa-gguf:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use kodetr/chatnusa-gguf with Ollama:
ollama run hf.co/kodetr/chatnusa-gguf:Q4_K_M
- Unsloth Desktop
- Pi
How to use kodetr/chatnusa-gguf with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf kodetr/chatnusa-gguf:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "kodetr/chatnusa-gguf:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use kodetr/chatnusa-gguf with Docker Model Runner:
docker model run hf.co/kodetr/chatnusa-gguf:Q4_K_M
- Lemonade
How to use kodetr/chatnusa-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull kodetr/chatnusa-gguf:Q4_K_M
Run and chat with the model
lemonade run user.chatnusa-gguf-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use kodetr/chatnusa-gguf with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf kodetr/chatnusa-gguf:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default kodetr/chatnusa-gguf:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use kodetr/chatnusa-gguf with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf kodetr/chatnusa-gguf:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "kodetr/chatnusa-gguf:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
ChatNusa adalah Large Language Model (LLM) percakapan cerdas yang diadaptasi khusus untuk bahasa-bahasa daerah di Provinsi Nusa Tenggara Barat (Bahasa Sasak, Bahasa Samawa / Sumbawa, Bahasa Mbojo / Bima & Dompu) serta Bahasa Indonesia.
Model ini dikembangkan oleh kodetr sebagai bagian dari ekosistem riset NusaNLP untuk melestarikan dan mendemokratisasi teknologi AI bagi bahasa-bahasa daerah berdaya rendah (low-resource regional languages).
chatnusa-gguf : GGUF
This model was finetuned and converted to GGUF format using Unsloth.
Example usage:
- For text only LLMs:
llama-cli -hf kodetr/chatnusa-gguf --jinja - For multimodal models:
llama-mtmd-cli -hf kodetr/chatnusa-gguf --jinja
Available Model files:
Qwen2.5-3B-Instruct.Q4_K_M.ggufDeveloped by: kodetr / NusaNLP Team
Base Model:
unsloth/Qwen2.5-3B-Instruct-unsloth-bnb-4bit(Qwen 2.5)Training Method: QLoRA (Quantized Low-Rank Adaptation) via Unsloth (2x faster, 70% less VRAM)
License: Apache 2.0
Supported Languages:
- ๐๏ธ Bahasa Sasak (
sas) โ Lombok (~3 juta penutur) - ๐ Bahasa Samawa (
smw) โ Sumbawa & Sumbawa Barat (~500 ribu penutur) - โฐ๏ธ Bahasa Mbojo (
bjn/ Bima) โ Bima & Dompu (~600 ribu penutur) - ๐ฎ๐ฉ Bahasa Indonesia (
id)
- ๐๏ธ Bahasa Sasak (
โจ Kemampuan Utama (Key Capabilities)
- ๐ Definisi & Leksikon Kamus Terpadu:
- Memahami puluhan ribu lema dan terjemahan kata daerah berdasarkan Kamus Terpadu Sasambo Balai Bahasa Provinsi NTB.
- ๐ฌ Analisis Morfologi & Struktur Kata:
- Mengurai kata turunan menjadi kata dasar (lemma), awalan (prefix), akhiran (suffix), dan infiks (infix).
- ๐ค Kesantunan Bertutur & Budaya Lokal:
- Mampu membedakan ragam halus/hormat (Basa Alus/Krama) dan ragam akrab (Basa Lumbrah) pada bahasa Sasak.
- Memahami falsafah adat luhur seperti "Maja Labo Dahu" (Bima/Dompu) dan "Sabalong Samalewa" (Sumbawa).
- ๐ Terjemahan Kontekstual Bilingual:
- Menerjemahkan kalimat dan frasa dari Bahasa Indonesia ke bahasa daerah NTB dan sebaliknya.
๐ Panduan Penggunaan (Quickstart)
1. Menggunakan Transformers & PEFT (Python)
import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model_id = "unsloth/Qwen2.5-3B-Instruct-unsloth-bnb-4bit"
lora_model_id = "kodetr/chatnusa-qwen-3b" # Ganti dengan ID repo Anda
# 1. Load tokenizer & model
tokenizer = AutoTokenizer.from_pretrained(lora_model_id)
base_model = AutoModelForCausalLM.from_pretrained(
base_model_id,
torch_dtype=torch.float16,
device_map="auto"
)
model = PeftModel.from_pretrained(base_model, lora_model_id)
model.eval()
# 2. Format percakapan
messages = [
{
"role": "system",
"content": "Anda adalah ChatNusa, asisten AI cerdas untuk bahasa daerah Nusa Tenggara Barat (Sasak, Samawa, Mbojo) dan Bahasa Indonesia."
},
{
"role": "user",
"content": "Napi kabar pelungguh? Apa bahasa Sasak dari 'saya ingin makan bersama di rumah'?"
}
]
# 3. Generate respons
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda")
outputs = model.generate(inputs, max_new_tokens=256, temperature=0.7, top_p=0.9)
response = tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True)
print(response)
- Downloads last month
- 105
4-bit