Mediocreatmybest
/

Phind-CodeLlama-34B-Python-v1_8bit_fp4

Text Generation

Inference Endpoints

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Mediocreatmybest commited on Aug 26, 2023

Commit

8c7b697

•

1 Parent(s): 2c0da49

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ tags:
 ---
 Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes)
-_8-bit / fp4 / float16_
 -_Mediocre_ 🥱

 ---
 Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes)
+_8-bit / fp4 / float16 / Safetensors_
 -_Mediocre_ 🥱