Zoyd
/

suzume-llama-3-8B-multilingual-6_5bpw-exl2

Text Generation

Generated from Trainer

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Zoyd commited on May 18

Commit

745afe7

•

1 Parent(s): fa84104

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ model-index:
 - name: lightblue/suzume-llama-3-8B-multilingual
   results: []
 ---
 <p align="center">
   <img width=400 src="https://cdn-uploads.huggingface.co/production/uploads/64b63f8ad57e02621dc93c8b/kg3QjQOde0X743csGJT-f.png" alt="Suzume - a Japanese tree sparrow"/>
 </p>

 - name: lightblue/suzume-llama-3-8B-multilingual
   results: []
 ---
+**Exllamav2** quant (**exl2** / **6.5 bpw**) made with ExLlamaV2 v0.0.21
 <p align="center">
   <img width=400 src="https://cdn-uploads.huggingface.co/production/uploads/64b63f8ad57e02621dc93c8b/kg3QjQOde0X743csGJT-f.png" alt="Suzume - a Japanese tree sparrow"/>
 </p>