Mediocreatmybest
/

Phind-CodeLlama-34B-Python-v1_8bit_nf4

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Mediocreatmybest commited on Aug 26, 2023

Commit

5a2f43a

•

1 Parent(s): 8ea5645

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ tags:
 ---
 Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes)
-_8-bit / nf4 / bfloat16_
 -_Mediocre_ 🥱

 ---
 Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes)
+_8-bit / nf4 / bfloat16 / Safetensors_
 -_Mediocre_ 🥱