Hugging Face's logo

dumb-dev
/
flan-t5-xxl-gguf

GGUF
llama.cpp
Inference Endpoints
Model card Files Community
dumb-dev commited on
Commit
631eb1f
•
1 Parent(s): 0f46be1

UPLOAD f16 and f32

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. converted-flan-t5-xxl-f16.gguf +3 -0
  3. converted-flan-t5-xxl-f32.gguf +3 -0
.gitattributes CHANGED
@@ -50,3 +50,5 @@ Q5/converted-flan-t5-xxl-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
  Q5/converted-flan-t5-xxl-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
51
  Q6/converted-flan-t5-xxl-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
52
  Q8/converted-flan-t5-xxl-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
50
  Q5/converted-flan-t5-xxl-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
51
  Q6/converted-flan-t5-xxl-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
52
  Q8/converted-flan-t5-xxl-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
53
+ converted-flan-t5-xxl-f16.gguf filter=lfs diff=lfs merge=lfs -text
54
+ converted-flan-t5-xxl-f32.gguf filter=lfs diff=lfs merge=lfs -text
converted-flan-t5-xxl-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c444648e8e17d1555b539b3ad283f4db395acce8e6245335615aecc1ef2d3555
3
+ size 22272719360
converted-flan-t5-xxl-f32.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b125e1e5e3cc10d37bd20c3cd83a2e55c5c66215b6cf2944a7b93885a2a0484
3
+ size 44542384640