Instructions to use elizaos/eliza-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use elizaos/eliza-1 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="elizaos/eliza-1", filename="bundles/0_6b/asr/eliza-1-asr-mmproj.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use elizaos/eliza-1 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf elizaos/eliza-1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf elizaos/eliza-1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf elizaos/eliza-1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf elizaos/eliza-1:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf elizaos/eliza-1:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf elizaos/eliza-1:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf elizaos/eliza-1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf elizaos/eliza-1:Q4_K_M
Use Docker
docker model run hf.co/elizaos/eliza-1:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use elizaos/eliza-1 with Ollama:
ollama run hf.co/elizaos/eliza-1:Q4_K_M
- Unsloth Studio new
How to use elizaos/eliza-1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for elizaos/eliza-1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for elizaos/eliza-1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for elizaos/eliza-1 to start chatting
- Docker Model Runner
How to use elizaos/eliza-1 with Docker Model Runner:
docker model run hf.co/elizaos/eliza-1:Q4_K_M
- Lemonade
How to use elizaos/eliza-1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull elizaos/eliza-1:Q4_K_M
Run and chat with the model
lemonade run user.eliza-1-Q4_K_M
List all available models
lemonade list
Eliza-1
Eliza-1 is the consolidated elizaOS local-inference model repository. Active runtime bundles live under bundles/<tier>/ and are resolved by eliza-1.manifest.json, checksums/SHA256SUMS, evals/aggregate.json, dflash/target-meta.json, and evidence/release.json inside each tier.
The current v1 bundle line packages base/upstream-derived GGUF runtime artifacts and release evidence. Fine-tuned Eliza weights are tracked as the next publishable release state; fine-tuning data, validation reports, and examples live in elizaos/eliza-1-training. Removed legacy long-context experiments are not part of the active release surface.
Active Bundles
| Tier | Remote path | Files | Size | Status |
|---|---|---|---|---|
0_8b |
bundles/0_8b/ |
72 | 4.78 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
2b |
bundles/2b/ |
64 | 7.75 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
4b |
bundles/4b/ |
72 | 12.78 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
9b |
bundles/9b/ |
85 | 24.44 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
27b |
bundles/27b/ |
64 | 41.02 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
27b-256k |
bundles/27b-256k/ |
63 | 41.02 GiB | release-candidate; see evidence/release.json and evals/aggregate.json |
Every active text tier ships both native context and half context variants. Current text contexts are 128k for the default runtime floor and 256k where the tier supports the native context variant.
Runtime Components
Each active bundle is designed as a streaming local-inference pipeline:
- text generation and structured response handling use llama.cpp-compatible GGUF artifacts and Eliza-specific HANDLE_RESPONSE rules;
- MTP / DFlash drafter artifacts live under
dflash/and are validated bydflash/target-meta.json; - TTS uses omnivoice.cpp-compatible voice artifacts where applicable;
- image generation uses stable-diffusion.cpp-compatible artifacts under
imagegen/; - ASR, VAD, vision, cache, and platform evidence are recorded in each bundle manifest when present.
The structured response contract requires closed action enums, Eliza schema-guided decoding, DFlash prefill support, and deterministic repair evidence. See each tier's evidence/release.json for the exact test reports currently attached to the bundle.
Training And Fine-Tuning
Training data is published in elizaos/eliza-1-training with root JSONL splits, Dataset Viewer parquet mirrors, a native-record validation report, and the smallest-tier fine-tuning runbook at pipeline/docs/training/eliza1-smallest-finetunes.md.
Fine-tuning policy for this release line is size-first: fine-tune only the smallest practical version of each model family first, compare fine-tuned results against the non-fine-tuned baseline, and publish only when the tier's eval gates, backend verification, kernel dispatch reports, checksums, licenses, and Hugging Face upload evidence pass.
Verification Surface
The release audit checks, without downloading large model files:
- required files for each active bundle;
- manifest coverage for text, TTS, ASR, VAD, image generation, vision, DFlash, and cache artifacts;
- native context and half context text entries;
- checksum and LFS hash agreement;
- backend verification for supported CPU, Metal, Vulkan, CUDA, and ROCm surfaces by tier;
- aggregate eval gates for text, voice, ASR, VAD, barge-in, 30-turn, E2E loop, and DFlash evidence;
- MTP / DFlash acceptance evidence;
- structured response evidence;
- dataset schema, privacy attestation, training contract, validation report, and split availability.
Use packages/training/scripts/manifest/audit_hf_eliza1_release.py in the elizaOS repository for the authoritative metadata gate.
- Downloads last month
- 168,648