Instructions to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF", filename="MiniCPM5-1B-lost-frequency-radio-Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Use Docker
docker model run hf.co/build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
- Ollama
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Ollama:
ollama run hf.co/build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
- Unsloth Studio
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF to start chatting
- Pi
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Docker Model Runner:
docker model run hf.co/build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
- Lemonade
How to use build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.MiniCPM5-1B-lost-frequency-radio-GGUF-Q4_K_M
List all available models
lemonade list
MiniCPM5-1B · Lost Frequency Radio (GGUF Q4_K_M)
LoRA fine-tune of openbmb/MiniCPM5-1B for Lost Frequency Radio, an interactive radio from parallel universes built for the Hugging Face Build Small Hackathon 2026 (track 🍄 An Adventure in Thousand Token Wood).
Demo: Lost Frequency Radio Space Dataset: ~786 surreal radio transmissions (es / en) with structured tokens, template-generated and hand-curated. Agent trace: the full build trace, scrubbed and shared on the Hub so others can see how it was made.
Task: write short in-character radio scripts (60 to 90 words): 1950s announcers, Jupiter weather reports, impossible commercials, number stations, late-night cross-universe call-in shows.
Two languages on a 1B model: the radio speaks Spanish and English, and the model keeps them apart, no bleeding one into the other. Getting two languages to hold up on a 1-billion-parameter model was the part I most wanted to push, and it worked.
Anti prompt-leak design: the system prompts contain no instruction-shaped rules ("write only the script, 60-90 words..."). The format is learned purely from the completions, so a 1B model has nothing instruction-shaped to "recite" on air.
Structured tokens
The model emits markers that the frontend turns into audiovisual events:
| Token | Effect on the radio |
|---|---|
[JINGLE] |
light pulse + arpeggio |
[INTERFERENCIA] |
screen glitch + burst of static |
[CORTE COMERCIAL] |
click + dimming |
[FIN DE TRANSMISION] |
display fade and signal drop |
Usage with llama.cpp
from llama_cpp import Llama
llm = Llama(model_path="MiniCPM5-1B-lost-frequency-radio-Q4_K_M.gguf", n_ctx=2048)
prompt = (
"<s><|im_start|>system\nYou are the official voice of the Jupiter Weather "
"Service, year 2187. You write radio scripts in Spanish.<|im_end|>\n"
"<|im_start|>user\nWrite tonight's transmission. On-air script only."
"<|im_end|>\n<|im_start|>assistant\n<think>\n\n</think>\n\n"
)
tokens = llm.tokenize(prompt.encode(), add_bos=False, special=True)
out = llm.create_completion(prompt=tokens, max_tokens=220, temperature=0.7,
stop=["<|im_end|>"])
print(out["choices"][0]["text"])
Note: the <think>\n\n</think>\n\n prefill disables MiniCPM5's reasoning mode (equivalent to enable_thinking=False in the chat template).
Training
- 786 examples (es / en), LoRA r=16, alpha=32, dropout 0.05, applied to every projection (q/k/v/o/gate/up/down)
- 3 epochs, lr 1e-4 cosine, bf16, max_length 768
- Hardware: a single RTX 4050 laptop (6 GB), the model is tiny by design
- Final loss ≈ 0.36-0.42, token accuracy ≈ 0.92
Files
MiniCPM5-1B-lost-frequency-radio-Q4_K_M.gguf: Q4_K_M quantization (~651 MB), the one the Space useslora-adapter/: LoRA adapters (to reproduce or continue training)
- Downloads last month
- 346
4-bit
Model tree for build-small-hackathon/MiniCPM5-1B-lost-frequency-radio-GGUF
Base model
openbmb/MiniCPM5-1B