Hugging Face's logo

nopperl
/
OLMo-1.7-7B-GGUF

Text Generation
GGUF
English
Inference Endpoints
Model card Files Community
nopperl commited on
Commit
1840f72
•
1 Parent(s): f913e08

add i-quants

Browse files
Files changed (6) hide show
  1. OLMo-1.7-7B.IQ2_M.gguf +3 -0
  2. OLMo-1.7-7B.IQ3_M.gguf +3 -0
  3. OLMo-1.7-7B.IQ3_S.gguf +3 -0
  4. OLMo-1.7-7B.IQ3_XS.gguf +3 -0
  5. OLMo-1.7-7B.IQ3_XXS.gguf +3 -0
  6. OLMo-1.7-7B.IQ4_NL.gguf +3 -0
OLMo-1.7-7B.IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:511d45d6bd40427564b6c839e2edb6ace027562eeadb28f6b25e007c7958ebd6
3
+ size 109691680
OLMo-1.7-7B.IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:852ca475e65c843c1f02231f7c0ece4505e116077dcf022647d4aa9a669a083c
3
+ size 3208557344
OLMo-1.7-7B.IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48792a2e16e75a36cc0325c0560799653f077eda543799751310f1ee49df141f
3
+ size 3041997600
OLMo-1.7-7B.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:216cce35d60da3b7aee1e01a2c6c56230dc1066d2f2cb91e75147bcd6a08e0db
3
+ size 2890216224
OLMo-1.7-7B.IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edaf034f500b50beca5637d1fb45727c90d11fd3aa6ef0d7f544a0d62b648a38
3
+ size 150201120
OLMo-1.7-7B.IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75deb3735c40e0e57eff22540a22bc3bc13c446e60f5f7e1bea774382a1e0fff
3
+ size 3952001824