Instructions to use SBDO1/SBD4.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SBDO1/SBD4.5 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SBDO1/SBD4.5:Q8_0 # Run inference directly in the terminal: llama cli -hf SBDO1/SBD4.5:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SBDO1/SBD4.5:Q8_0 # Run inference directly in the terminal: llama cli -hf SBDO1/SBD4.5:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SBDO1/SBD4.5:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf SBDO1/SBD4.5:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SBDO1/SBD4.5:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf SBDO1/SBD4.5:Q8_0
Use Docker
docker model run hf.co/SBDO1/SBD4.5:Q8_0
- LM Studio
- Jan
- vLLM
How to use SBDO1/SBD4.5 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SBDO1/SBD4.5" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SBDO1/SBD4.5", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SBDO1/SBD4.5:Q8_0
- Ollama
How to use SBDO1/SBD4.5 with Ollama:
ollama run hf.co/SBDO1/SBD4.5:Q8_0
- Unsloth Desktop
- Pi
How to use SBDO1/SBD4.5 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SBDO1/SBD4.5:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SBDO1/SBD4.5:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use SBDO1/SBD4.5 with Docker Model Runner:
docker model run hf.co/SBDO1/SBD4.5:Q8_0
- Lemonade
How to use SBDO1/SBD4.5 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SBDO1/SBD4.5:Q8_0
Run and chat with the model
lemonade run user.SBD4.5-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use SBDO1/SBD4.5 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SBDO1/SBD4.5:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SBDO1/SBD4.5:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use SBDO1/SBD4.5 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SBDO1/SBD4.5:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "SBDO1/SBD4.5:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
SBD4.5
SBD4.5 is a 3 billion parameter language model designed primarily for coding assistance and general conversation.
The model is intended to help with code generation, code explanation, debugging, technical questions, and natural-language chat.
SBD4.5 is an independently developed model and is not presented as a fine-tune of another released base model.
Model Details
| Property | Value |
|---|---|
| Model | SBD4.5 |
| Parameters | ~3B |
| Architecture | Decoder-only / autoregressive language model |
| Base model | None |
| Primary purpose | Coding + Chat |
| Primary language | English |
| License | Apache License 2.0 |
| Status | Experimental |
| Tokenizer | BPE |
| Training dataset | Convence/Rust-Coder |
Training Data
SBD4.5 uses data from:
Convence/Rust-Coder
https://huggingface.co/datasets/Convence/Rust-Coder
The dataset provides programming-oriented training data with a particular emphasis on Rust and software-development tasks.
Additional datasets or training sources should be documented here if they are used in future versions of SBD4.5.
Tokenizer
SBD4.5 uses a Byte-Pair Encoding (BPE) tokenizer.
The tokenizer includes tokens intended for conversational formatting, including:
<|im_start|>
<|im_end|>
<|endoftext|>
It also includes Fill-in-the-Middle tokens useful for coding workflows:
<|fim_prefix|>
<|fim_middle|>
<|fim_suffix|>
<|fim_pad|>
This allows the tokenizer to represent both normal conversational text and code-oriented completion patterns.
Intended Uses
SBD4.5 is designed for:
- General conversation
- Programming assistance
- Code generation
- Code completion
- Code explanation
- Debugging assistance
- Rust programming
- Software-development questions
- Technical explanations
- Refactoring suggestions
- Generating scripts and utilities
- Explaining errors and stack traces
- Fill-in-the-Middle code completion
Coding Capabilities
SBD4.5 is primarily intended as a coding-oriented model.
Its training data places particular emphasis on Rust, although the tokenizer and model may support other programming languages depending on the model's broader training data.
Potential use cases include:
fn main() {
println!("Hello from SBD4.5!");
}
as well as explaining, debugging, or modifying existing programs.
Example
User
Write a Rust function that determines whether a number is prime.
Assistant
fn is_prime(n: u64) -> bool {
if n < 2 {
return false;
}
let limit = (n as f64).sqrt() as u64;
for i in 2..=limit {
if n % i == 0 {
return false;
}
}
true
}
Chat Usage
SBD4.5 can also be used as a conversational assistant.
Example:
User: What is ownership in Rust?
Assistant: Ownership is Rust's system for managing memory without requiring
a garbage collector. Every value has an owner, and when that owner goes out
of scope, the value is automatically dropped.
Strengths
SBD4.5 is intended to perform well on tasks involving:
- Programming
- Rust code
- Code completion
- Code explanation
- Technical Q&A
- Debugging
- Conversational assistance
- Software-development workflows
Limitations
SBD4.5 can generate incorrect or misleading output.
In particular, the model may:
- Generate code that does not compile.
- Produce logical bugs.
- Suggest insecure implementations.
- Hallucinate libraries, APIs, functions, or configuration options.
- Misunderstand complex requirements.
- Generate outdated technical information.
- Produce confident answers that are incorrect.
- Perform unevenly across programming languages.
All generated code should be reviewed and tested before being used in production.
Security-sensitive code should receive additional manual review.
Safety
SBD4.5 is an experimental language model.
Generated responses should not automatically be treated as factual or safe to execute.
Users should carefully inspect generated commands and programs, particularly when they involve:
- File deletion
- System administration
- Network access
- Authentication
- Credentials
- Databases
- Production infrastructure
- Security-sensitive applications
Training
Model Size
SBD4.5 contains approximately:
3 billion parameters
Training Dataset
Primary documented dataset:
Convence/Rust-Coder
Dataset page:
https://huggingface.co/datasets/Convence/Rust-Coder
Training Method
SBD4.5 is trained as an independent model rather than being distributed as a fine-tuned checkpoint of another base model.
Additional information about:
- Optimizer
- Learning rate
- Batch size
- Sequence length
- Number of training tokens
- Hardware
- Training duration
- Training framework
can be added once those details are finalized.
Evaluation
Formal benchmark results are not currently published.
Future evaluations may include:
Coding
- HumanEval
- HumanEval+
- MBPP
- MultiPL-E
- Rust-specific coding benchmarks
General Ability
- Instruction following
- Reasoning
- General knowledge
- Conversational quality
Reliability
- Compilation success rate
- Unit-test pass rate
- Hallucination rate
- Security evaluation
Benchmark results should be reported here when available rather than inferred from parameter count or training data.
License
SBD4.5 is released under the Apache License 2.0.
Users should also review the licenses and terms associated with any datasets used during training.
Version
SBD4.5
- Approximately 3B parameters
- Coding + conversational model
- Rust-oriented training data
- BPE tokenizer
- Fill-in-the-Middle token support
- Apache-2.0 license
Disclaimer
SBD4.5 is an experimental AI model.
Generated information and code may be inaccurate, unsafe, incomplete, or inappropriate for a particular application.
Always review and test important outputs before relying on them.
- Downloads last month
- -
4-bit
8-bit