unsloth
/

llama-2-7b-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

danielhanchen commited on Nov 29, 2023

Commit

16cfa6e

•

1 Parent(s): 072daa5

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -1,3 +1,4 @@
 ---
 license: llama2
 ---

 ---
 license: llama2
 ---
+Will add a 4bit quantized upload once https://github.com/huggingface/transformers/pull/26037 gets merged.