llm.create_chat_completion(
messages = "No input example has been defined for this model task."
)MiniCPM4.1-8B-PaperProf-GGUF
GGUF quantizations of build-small-hackathon/MiniCPM4.1-8B-PaperProf, the fine-tuned exam-question generator behind PaperProf.
| File | Quant | Size | Use |
|---|---|---|---|
minicpm4-1-8b-paperprof-Q4_K_M.gguf |
Q4_K_M | ~4.9 GB | recommended, used by the Space |
minicpm4-1-8b-paperprof-f16.gguf |
F16 | ~16 GB | full precision reference |
Usage with llama.cpp
llama-cli -hf build-small-hackathon/MiniCPM4.1-8B-PaperProf-GGUF -p "your prompt"
Usage with llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained("build-small-hackathon/MiniCPM4.1-8B-PaperProf-GGUF", filename="*Q4_K_M.gguf", n_gpu_layers=-1)
Built for the Build Small Hackathon, June 2026, by Team PaperProf (EPITA).
- Downloads last month
- 18
Hardware compatibility
Log In to add your hardware
4-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for build-small-hackathon/MiniCPM4.1-8B-PaperProf-GGUF
Base model
openbmb/MiniCPM4.1-8B
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="build-small-hackathon/MiniCPM4.1-8B-PaperProf-GGUF", filename="", )