onekq-ai
/

starcoder2-3b-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

onekq commited on Oct 18

Commit

04a8e39

•

1 Parent(s): 3bf0ceb

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -5,7 +5,9 @@ base_model:
 - bigcode/starcoder2-3b
 ---
-Bitsandbytes quantization of https://huggingface.co/bigcode/starcoder2-3b. See https://huggingface.co/blog/4bit-transformers-bitsandbytes for instructions.
 ```python
 from transformers import AutoModelForCausalLM

 - bigcode/starcoder2-3b
 ---
+Bitsandbytes quantization of https://huggingface.co/bigcode/starcoder2-3b.
+See https://huggingface.co/blog/4bit-transformers-bitsandbytes for instructions.
 ```python
 from transformers import AutoModelForCausalLM