bullerwins
/

Qwen2-72B-Instruct_exl2_8.0bpw

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

bullerwins commited on Jun 7

Commit

87ffd0d

•

1 Parent(s): 32920a0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ tags:
 - chat
 ---
-Quantized version in exl2 format using [Exllama2](https://github.com/turboderp/exllamav2)
 # Qwen2-72B-Instruct

 - chat
 ---
+Quantized version in exl2 format using [Exllama2 0.1.4](https://github.com/turboderp/exllamav2)
 # Qwen2-72B-Instruct