Text Generation
Transformers
Safetensors
GGUF
English
stablelm
causal-lm
conversational
Inference Endpoints
Ashish commited on
Commit
9e73e07
1 Parent(s): e795a4e

OpenVINO NNCF 4BIT quantization

Browse files
stablelm-2-zephyr-1_6b-OpenVINO-4bit.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c284c859d1c39afc3812135a72180da0034788dfa3db459d55334184343004c8
3
+ size 1048432977
stablelm-2-zephyr-1_6b-OpenVINO-4bit.xml ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15fc44d0b227c3392dfed17ec1d96bc22462857cf3470336fa1c37ce7b3e4c34
3
+ size 2885612