Hugging Face's logo

hs-hf
/
madlad400-3b-mt-gguf

Translation
GGUF
Inference Endpoints
Model card Files Community
hs-hf commited on
Commit
a2ebe1a
•
1 Parent(s): a64447f

Converted the google/madlad400-3b-mt model into quantized GGUF format

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. madlad400-3b-mt-FP16.gguf +3 -0
  3. madlad400-3b-mt-q4_k_m.gguf +3 -0
  4. madlad400-3b-mt-q4_k_s.gguf +3 -0
  5. madlad400-3b-mt-q5_k_m.gguf +3 -0
  6. madlad400-3b-mt-q5_k_s.gguf +3 -0
  7. madlad400-3b-mt-q6_k.gguf +3 -0
  8. madlad400-3b-mt-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ madlad400-3b-mt-FP16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ madlad400-3b-mt-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
38
+ madlad400-3b-mt-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
39
+ madlad400-3b-mt-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ madlad400-3b-mt-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
41
+ madlad400-3b-mt-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
42
+ madlad400-3b-mt-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
madlad400-3b-mt-FP16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e25b7ccbfc5cb2933d0b7b1a2effd0c3248d208a4008e21d907b303f989ca567
3
+ size 5887332128
madlad400-3b-mt-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa4f14073b53bdadfa843cd986dc7e778cff2d65298fdb83b1fb5c6dcd0085d6
3
+ size 1858129696
madlad400-3b-mt-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4757d2e516c142f9b3dc00fa0306742cef78d7db4a681c10009b75d330550b6f
3
+ size 1733611296
madlad400-3b-mt-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cc566227f92b11752923a6302c8fc3cdfe0b5b07071159d77bfeeebd40db6d4
3
+ size 2129973024
madlad400-3b-mt-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c69396d00118f49575885854ab564f4b3d0a76440426cb9dfc8615859746bd9
3
+ size 2063126304
madlad400-3b-mt-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc230c7908b76004488d899d433ef3046b868aa5593993b41094b4d795bc42aa
3
+ size 2418806560
madlad400-3b-mt-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e0897265e1d6f171880b618c45aca30b55019ff4a90aba152fbc197c0451771
3
+ size 3130887968