sethuiyer commited on
Commit
ae7bb06
1 Parent(s): 43e6758

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -72,6 +72,14 @@ What is your name?
72
  My name is Samantha.
73
  ```
74
 
 
 
 
 
 
 
 
 
75
  ## OpenLLM Leaderboard Performance
76
  | T | Model | Average | ARC | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K |
77
  |---|----------------------------------|---------|-------|-----------|-------|------------|------------|-------|
 
72
  My name is Samantha.
73
  ```
74
 
75
+ ## ⚡ Quantized models
76
+
77
+ * **GGUF**:https://huggingface.co/TheBloke/Dr_Samantha-7B-GGUF
78
+ * **GPTQ**: https://huggingface.co/TheBloke/Dr_Samantha-7B-GPTQ
79
+ * **AWQ**: https://huggingface.co/TheBloke/Dr_Samantha-7B-AWQ
80
+
81
+ Thanks to [TheBloke](https://huggingface.co/TheBloke) for making this available!
82
+
83
  ## OpenLLM Leaderboard Performance
84
  | T | Model | Average | ARC | Hellaswag | MMLU | TruthfulQA | Winogrande | GSM8K |
85
  |---|----------------------------------|---------|-------|-----------|-------|------------|------------|-------|