minicpm-5

This repository hosts the MiniCPM5-2B model exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Source: openbmb/MiniCPM5-2B, revision f97400052a43d642bbc6e9975e2397e3ae6a6b52 (final post-trained checkpoint).

Variants

Path Backend Precision Context length
mlx/minicpm_5_2b_mlx_4w.pte mlx int4 8,192
xnnpack/minicpm_5_2b_xnnpack_8da4w.pte xnnpack 8da4w 8,192

Repository structure

mlx/config.json                           1.3 KiB
mlx/minicpm_5_2b_mlx_4w.pte               1.3 GiB
tokenizer.json                            5.0 MiB
tokenizer_config.json                    97.5 KiB
xnnpack/config.json                       1.3 KiB
xnnpack/minicpm_5_2b_xnnpack_8da4w.pte    1.3 GiB

Export notes

128-token prefill and float32 logits. Thinking is enabled; history omits reasoning. MLX requires Apple silicon.

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for software-mansion/react-native-executorch-minicpm-5

Quantized
(110)
this model

Collection including software-mansion/react-native-executorch-minicpm-5