File size: 460 Bytes

c1c1634
0634bc8
c1c1634
1bd0627
 
 
0634bc8
 
4f77e76
c1c1634
 
d9e30aa
 
02cf692
c1c1634
f574c37
e3abece
 
f574c37
e3abece
c1c1634

---
base_model: allenai/OLMo-7B-0424-hf
license: apache-2.0
language:
- en
pipeline_tag: text2text-generation
tags:
- olmo
quantized_by: robolamp
---

Quantized versions of https://huggingface.co/allenai/OLMo-7B-0424-hf

**NB**: *Q8_K* is not supported by default llama.cpp, use *Q8_0* instead.

bits per weight vs size plot:


![image/png](https://cdn-uploads.huggingface.co/production/uploads/63af30a6874f03948c8e3d82/-bUdp3RGswnueD3jFiLLO.png)

TODO: readme