Mozilla
/

gemma-2-9b-it-llamafile

Inference Endpoints

Model card Files Files and versions Community

jartine commited on Jun 29

Commit

62827ef

•

1 Parent(s): 92eeb10

Quantize Q5_K_S with llamafile-0.8.8

Files changed (2) hide show

.gitattributes +1 -0
gemma-2-9b-it.Q5_K_S.llamafile +3 -0

.gitattributes CHANGED Viewed

@@ -46,3 +46,4 @@ gemma-2-9b-it.Q3_K_S.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q3_K_M.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q3_K_L.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q4_K_S.llamafile filter=lfs diff=lfs merge=lfs -text

 gemma-2-9b-it.Q3_K_M.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q3_K_L.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q4_K_S.llamafile filter=lfs diff=lfs merge=lfs -text
+gemma-2-9b-it.Q5_K_S.llamafile filter=lfs diff=lfs merge=lfs -text

gemma-2-9b-it.Q5_K_S.llamafile ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7a11e1a8b4b035df9e43d7d72a3f59830aac752f16a931e30e8421df1830c880
+size 6513703148