This repo includes the GGUF versions of MiniCPM3-4B:

minicpm3-4b-fp16.gguf
minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month: 8,006

GGUF

Model size

4.07B params

Architecture

minicpm3

4-bit

View +1 file

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for openbmb/MiniCPM3-4B-GGUF

Base model

openbmb/MiniCPM3-4B

Quantized

(8)

this model

Quantizations

2 models

Collection including openbmb/MiniCPM3-4B-GGUF

MiniCPM

Collection

The MiniCPM family of LLMs and VLLMs. • 32 items • Updated 16 days ago • 61