jartine
/

gemma-2-9b-it-llamafile

Inference Endpoints

Model card Files Files and versions Community

jartine commited on 19 days ago

Commit

8906c87

•

1 Parent(s): 1fe2881

Quantize Q2_K with llamafile-0.8.16

Files changed (2) hide show

.gitattributes +1 -0
gemma-2-9b-it.Q2_K.llamafile +3 -0

.gitattributes CHANGED Viewed

@@ -41,3 +41,4 @@ gemma-2-9b-it.Q4_K_M.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.BF16.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.F16.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q5_1.llamafile filter=lfs diff=lfs merge=lfs -text

 gemma-2-9b-it.BF16.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.F16.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q5_1.llamafile filter=lfs diff=lfs merge=lfs -text
+gemma-2-9b-it.Q2_K.llamafile filter=lfs diff=lfs merge=lfs -text

gemma-2-9b-it.Q2_K.llamafile ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8c798e85af954efbb91be3135250ad8533d34cc5315b347cd4250f90c7c662c
+size 3975297177