Felladrin
/

gguf-OLMoE-1B-7B-0924-Instruct

Inference Endpoints

Model card Files Files and versions Community

gguf-OLMoE-1B-7B-0924-Instruct

1 contributor

History: 2 commits

Felladrin's picture

Upload folder using huggingface_hub

6772d35 verified 2 months ago

.gitattributes

2.03 kB

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.IQ4_XS.gguf

3.79 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q2_K.gguf

2.66 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q3_K.gguf

3.43 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q4_K.gguf

4.29 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q5_K.gguf

4.99 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q6_K.gguf

5.73 GB
LFS

Upload folder using huggingface_hub 2 months ago
OLMoE-1B-7B-0924-Instruct.Q8_0.gguf

7.36 GB
LFS

Upload folder using huggingface_hub 2 months ago
README.md

166 Bytes

Upload folder using huggingface_hub 2 months ago