mradermacher
/

speechless-mistral-dolphin-orca-platypus-samantha-7b-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

speechless-mistral-dolphin-orca-platypus-samantha-7b-i1-GGUF

1 contributor

History: 13 commits

mradermacher's picture

uploaded from db3

b1dc9ee verified 12 days ago

.gitattributes

2.5 kB

uploaded from db3 12 days ago
README.md

268 Bytes

uploaded from db3 12 days ago
imatrix.dat

4.99 MB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ1_M.gguf

1.75 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ2_M.gguf

2.5 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ3_M.gguf

3.28 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ3_XXS.gguf

2.83 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q2_K.gguf

2.72 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q3_K_M.gguf

3.52 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q4_K_M.gguf

4.37 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q4_K_S.gguf

4.14 GB
LFS

uploaded from db3 12 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q6_K.gguf

5.94 GB
LFS

uploaded from db3 12 days ago