Text Generation
Transformers
GGUF
English
stablelm
causal-lm
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
8 papers
afrideva commited on
Commit
b98fb0f
1 Parent(s): 1d6f7e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -36,6 +36,9 @@ tags:
36
 
37
  Quantized GGUF model files for [stablelm-3b-4e1t](https://huggingface.co/stabilityai/stablelm-3b-4e1t) from [stabilityai](https://huggingface.co/stabilityai)
38
 
 
 
 
39
 
40
  | Name | Quant method | Size |
41
  | ---- | ---- | ---- |
 
36
 
37
  Quantized GGUF model files for [stablelm-3b-4e1t](https://huggingface.co/stabilityai/stablelm-3b-4e1t) from [stabilityai](https://huggingface.co/stabilityai)
38
 
39
+ ** StableLM support currently requires using this [llama.cpp fork](https://github.com/Galunid/llama.cpp/tree/stablelm-support) by [Galunid](https://github.com/Galunid). Quantized and tested with the `stablelm-support` branch, commit `a00bb06` **
40
+
41
+ StableLM support pull request: https://github.com/ggerganov/llama.cpp/pull/3586
42
 
43
  | Name | Quant method | Size |
44
  | ---- | ---- | ---- |