neopolita
/

olmo-1.7-7b-hf-gguf

Inference Endpoints

Model card Files Files and versions Community

olmo-1.7-7b-hf-gguf

1 contributor

History: 10 commits

neopolita's picture

Upload olmo-1.7-7b-hf_q4_k_m.gguf with huggingface_hub

afa8f26 verified 10 months ago

.gitattributes

1.95 kB

Upload olmo-1.7-7b-hf_q4_k_m.gguf with huggingface_hub 10 months ago
README.md

1.41 kB

Upload README.md with huggingface_hub 10 months ago
ggml-model-f16.gguf

13.8 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q2_k.gguf

2.62 GB
LFS

Upload olmo-1.7-7b-hf_q2_k.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q3_k_m.gguf

3.39 GB
LFS

Upload olmo-1.7-7b-hf_q3_k_m.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q4_k_m.gguf

4.18 GB
LFS

Upload olmo-1.7-7b-hf_q4_k_m.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q5_k_m.gguf

4.9 GB
LFS

Upload olmo-1.7-7b-hf_q5_k_m.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q6_k.gguf

5.65 GB
LFS

Upload olmo-1.7-7b-hf_q6_k.gguf with huggingface_hub 10 months ago
olmo-1.7-7b-hf_q8_0.gguf

7.32 GB
LFS

Upload olmo-1.7-7b-hf_q8_0.gguf with huggingface_hub 10 months ago