Hugging Face's logo

nopperl
/
OLMo-1.7-7B-GGUF

Text Generation
GGUF
English
Inference Endpoints
Model card Files Community
nopperl commited on
Commit
678541f
•
1 Parent(s): 2bdb5fc

add quants

Browse files
Files changed (10) hide show
  1. OLMo-1.7-7B.Q2_K.gguf +3 -0
  2. OLMo-1.7-7B.Q3_K_L.gguf +3 -0
  3. OLMo-1.7-7B.Q3_K_M.gguf +3 -0
  4. OLMo-1.7-7B.Q3_K_S.gguf +3 -0
  5. OLMo-1.7-7B.Q4_K_M.gguf +3 -0
  6. OLMo-1.7-7B.Q4_K_S.gguf +3 -0
  7. OLMo-1.7-7B.Q5_K_M.gguf +3 -0
  8. OLMo-1.7-7B.Q5_K_S.gguf +3 -0
  9. OLMo-1.7-7B.Q6_K.gguf +3 -0
  10. OLMo-1.7-7B.Q8_0.gguf +3 -0
OLMo-1.7-7B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d74bc514b83d38ce6a7829bd120b8622dabe3673a9dd1837e08daa7bf81963b1
3
+ size 2618942240
OLMo-1.7-7B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1621de40bf335ec3288843ae84eb9f759dd78e38c63a936e9c6d5e6235110a0
3
+ size 3690804000
OLMo-1.7-7B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79c4f2c6bd880152a18765c08d31cccb1d2cb1ba4749bf2b293c519b7a094cb2
3
+ size 3391697696
OLMo-1.7-7B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:947d031aef0e0a37e808986e80222732e05c6e5435c646becdc5ecc25976a1c8
3
+ size 3041997600
OLMo-1.7-7B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1646162cdbc8c7a754225a255603b5eac2ba2948fa3c56ef3501058363ba4481
3
+ size 4184654624
OLMo-1.7-7B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55bf7a90f88b31e15bd9622ee9f7cd14a03a25df66b5360691c3e68bc617f4c5
3
+ size 3960390432
OLMo-1.7-7B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1010f5048551421eb4fcded9d7fd9cde52d60a1678d67f559e562ceb39b3c678
3
+ size 4896178976
OLMo-1.7-7B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c9d4a139ac50d2209c560b0a3b9223f7f383032e20130c9979dca6541e8b545
3
+ size 4764713760
OLMo-1.7-7B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86ca1eefd37c6bf6b05799a6ee4c37c514fb61af7dfa75395f350faf5efed9a3
3
+ size 5652173600
OLMo-1.7-7B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3d64740d2249d87c3425fa9d3daa6c8bfa4b1b14450fa1ba29304894f743144
3
+ size 7320384288