Text Generation
Transformers
Safetensors
GGUF
English
stablelm
causal-lm
conversational
Inference Endpoints
ashishdatta commited on
Commit
8b1a48d
1 Parent(s): 8e5b1aa

GGUF Q4_0, Q4_1, Q8_0 quantized files

Browse files
stablelm-2-zephyr-1_6b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:342f89616e40d79e57ff213d68fcdcab18a94f7370c1fb9526ff57f3e93721e3
3
+ size 982781952
stablelm-2-zephyr-1_6b-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5869cc65f65e361979a1e0e67353354e1a5088c4e0f61a3789bc9bf4f0b435b5
3
+ size 1072697344
stablelm-2-zephyr-1_6b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2607e6fcb3de0b7a7230f2fc12912541173d3eba80d92f141b1968e1552f0c6
3
+ size 1751879680