pmysl
/

c4ai-command-r-plus-GGUF

Text Generation

Model card Files Files and versions Community

c4ai-command-r-plus-GGUF / imatrix

1 contributor

History: 16 commits

pmysl's picture

BPE pre-tokenization for IQ4_XS variant

5b3ca40 about 2 months ago

command-r-plus-IQ1_M.gguf
25.2 GB
LFS

Add chat template to IQ1_M variant 3 months ago
command-r-plus-IQ1_S.gguf
23.2 GB
LFS

Add chat template to IQ1_S variant 3 months ago
command-r-plus-IQ2_M.gguf
36 GB
LFS

Add chat template to IQ2_M variant 3 months ago
command-r-plus-IQ2_S.gguf
33.3 GB
LFS

Add chat template to IQ2_S variant 3 months ago
command-r-plus-IQ2_XS.gguf
31.6 GB
LFS

Add chat template to IQ2_XS variant 3 months ago
command-r-plus-IQ2_XXS.gguf
28.6 GB
LFS

Add chat template to IQ2_XXS variant 3 months ago
command-r-plus-IQ3_M.gguf
47.7 GB
LFS

Add chat template to IQ3_M variant 3 months ago
command-r-plus-IQ3_S.gguf
46 GB
LFS

Add chat template to IQ3_S variant 3 months ago
command-r-plus-IQ3_XS.gguf
43.6 GB
LFS

Add chat template to IQ3_XS variant 3 months ago
command-r-plus-IQ3_XXS.gguf
40.7 GB
LFS

Add chat template to IQ3_XXS variant 3 months ago
command-r-plus-IQ4_NL-00001-of-00002.gguf
31.8 GB
LFS

Add chat template to IQ4_NL variant 3 months ago
command-r-plus-IQ4_NL-00002-of-00002.gguf
27.5 GB
LFS

Add imatrix variants 4 months ago
command-r-plus-IQ4_XS-00001-of-00002.gguf
30.2 GB
LFS

BPE pre-tokenization for IQ4_XS variant about 2 months ago
command-r-plus-IQ4_XS-00002-of-00002.gguf
26 GB
LFS

Add imatrix variants 4 months ago
command-r-plus-Q2_K_S.gguf
36.6 GB
LFS

BPE pre-tokenization for Q2_K_S variant about 2 months ago
command-r-plus-f16-c2048-groups_merged-imatrix.dat
27.5 MB
LFS

Add imatrix variants 4 months ago