Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,8 @@ Model creator: [ajibawa-2023](https://huggingface.co/ajibawa-2023)
|
|
| 16 |
[5bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/5bpw-h8)
|
| 17 |
[6bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/6bpw-h8)
|
| 18 |
[8bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/8bpw-h8)
|
|
|
|
|
|
|
| 19 |
|
| 20 |
## Original model card:
|
| 21 |
|
|
|
|
| 16 |
[5bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/5bpw-h8)
|
| 17 |
[6bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/6bpw-h8)
|
| 18 |
[8bpw h8](https://huggingface.co/cgus/SlimOrca-13B-exl2/tree/8bpw-h8)
|
| 19 |
+
|
| 20 |
+
Quantization is made with Exllamav2 0.0.8 with Pile as a calibration dataset.
|
| 21 |
|
| 22 |
## Original model card:
|
| 23 |
|