Update README.md

README.md

@@ -2,6 +2,7 @@
 license: other
 license_name: yi-license
 license_link: LICENSE
+inference: false
 widget:
   - example_title: "Yi-34B-Chat"
     text: "hi"
@@ -14,6 +15,23 @@ widget:
 pipeline_tag: text-generation
 ---
 
+# Yi-9B-exl2
+Original model: [Yi-9B](https://huggingface.co/01-ai/Yi-9B)  
+Model creator: [01-ai](https://huggingface.co/01-ai/)
+## Quants
+
+[4.25bpw-h8 (main)](https://huggingface.co/cgus/Yi-9B-exl2/tree/main)  
+[4.65bpw-h8](https://huggingface.co/cgus/Yi-9B-exl2/tree/4.65bpw-h8)  
+[5bpw-h8](https://huggingface.co/cgus/Yi-9B-exl2/tree/5bpw-h8)  
+[6bpw-h8](https://huggingface.co/cgus/Yi-9B-exl2/tree/6bpw-h8)  
+[8bpw-h8](https://huggingface.co/cgus/Yi-9B-exl2/tree/8bpw-h8)  
+
+## Quantization notes
+
+Made with exllamav2 0.0.15 with the default dataset.  
+This model can be loaded with apps that have exllamav2 loader, 
+such as [Text-Generation-WebUI](https://github.com/oobabooga/text-generation-webui), 
+[KoboldAI](https://github.com/henk717/KoboldAI), [ExUI](https://github.com/turboderp/exui), etc.
 <div align="center">
 
 <picture>