This repo includes the GGUF versions of MiniCPM3-4B:

  • minicpm3-4b-fp16.gguf
  • minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month
8,713
GGUF
Model size
4.07B params
Architecture
minicpm3

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for openbmb/MiniCPM3-4B-GGUF

Quantized
(8)
this model
Quantizations
2 models

Collection including openbmb/MiniCPM3-4B-GGUF