Update README.md

README.md

@@ -1,6 +1,7 @@
 ---
 license: apache-2.0
-base_model: Qwen/Qwen2-1.5B
+base_model: Replete-AI/Replete-Coder-Qwen2-1.5b
+inference: false
 tags:
 - text-generation-inference
 - transformers
@@ -154,7 +155,25 @@ model-index:
       name: Open LLM Leaderboard
 
 ---
+# Replete-Coder-Qwen2-1.5b-exl2
+
+Model: [Replete-Coder-Qwen2-1.5b](https://huggingface.co/Replete-AI/Replete-Coder-Qwen2-1.5b)  
+Model creator: [Rombodawg](https://huggingface.co/rombodawg)  
+
+Based on original model: [Qwen2-1.5B](https://huggingface.co/Qwen/Qwen2-1.5B)  
+Created by: [Qwen](https://huggingface.co/Qwen)  
+## Quants
+[4bpw h6 (main)](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/main)  
+[4.25bpw h6](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/4.25bpw-h6)  
+[4.65bpw h6](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/4.65bpw-h6)  
+[5bpw h6](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/5bpw-h6)  
+[6bpw h6](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/6bpw-h6)  
+[8bpw h8](https://huggingface.co/cgus/Replete-Coder-Qwen2-1.5b-exl2/tree/8bpw-h8)  
+## Quantization notes
+Made with Exllamav2 0.1.6 with the default dataset.
+# Original model card
 # Replete-Coder-Qwen2-1.5b
+
 Finetuned by: Rombodawg
 ### More than just a coding model!
 Although Replete-Coder has amazing coding capabilities, its trained on vaste amount of non-coding data, fully cleaned and uncensored. Dont just use it for coding, use it for all your needs! We are truly trying to make the GPT killer!