RuyiAI/buddy-deepseek-r1-w8a8

Cross-compiled RISC-V (riscv64) .rax package for the buddy-cli runtime.

• version: 60f354a
• target: generic riscv64 (any VLEN, no Zfh/Zvfh)
• upstream model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
• source: 60f354a7b659a1ce36fdf9ba7bd97fdbf6bb0e5f

1. Download the model

pip install -U "huggingface_hub[cli]"
hf download RuyiAI/buddy-deepseek-r1-w8a8 --local-dir deepseek_r1-w8a8

2. Install buddy-cli

curl -fsSL https://raw.githubusercontent.com/buddy-compiler/buddy-mlir/main/scripts/install_buddy_cli.sh | bash
export PATH="$HOME/.local/bin:$PATH"

3. Run

buddy-cli --model deepseek_r1-w8a8/deepseek_r1-w8a8.rax --prompt "hello"