Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
larenspear
/
OLMo-7B-Instruct-hf-GGUF
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
dac4fa8
OLMo-7B-Instruct-hf-GGUF
1 contributor
History:
2 commits
larenspear
GGUF Quantization
dac4fa8
8 months ago
.gitattributes
Safe
1.52 kB
initial commit
8 months ago
olmo-7b-instruct-hf-q2_k.gguf
2.62 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q3_k_l.gguf
3.69 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q3_k_m.gguf
3.39 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q3_k_s.gguf
3.04 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q4_k_m.gguf
4.18 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q4_k_s.gguf
3.96 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q5_k_m.gguf
4.9 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q5_k_s.gguf
4.76 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q6_k.gguf
5.65 GB
LFS
GGUF Quantization
8 months ago
olmo-7b-instruct-hf-q8_0.gguf
7.32 GB
LFS
GGUF Quantization
8 months ago
