Update README.md
Browse files
README.md
CHANGED
|
@@ -49,6 +49,15 @@ quantized_by: TheBloke
|
|
| 49 |
|
| 50 |
This repo contains GPTQ model files for [OpenOrca's Mixtral SlimOrca 8X7B](https://huggingface.co/Open-Orca/Mixtral-SlimOrca-8x7B).
|
| 51 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
|
| 53 |
|
| 54 |
<!-- description end -->
|
|
|
|
| 49 |
|
| 50 |
This repo contains GPTQ model files for [OpenOrca's Mixtral SlimOrca 8X7B](https://huggingface.co/Open-Orca/Mixtral-SlimOrca-8x7B).
|
| 51 |
|
| 52 |
+
## Requires AutoGPTQ PR + transformers 4.36.0
|
| 53 |
+
|
| 54 |
+
These files were made with, and will currently only work with, AutoGPTQ 0.6 compiled from source. A full AutoGPTQ 0.6 release is coming very soon.
|
| 55 |
+
|
| 56 |
+
You also need Transformers version 4.36.0, released December 11th.
|
| 57 |
+
|
| 58 |
+
Transformers GPTQ support is also available by installing Transformers from Github - more details on this soon.
|
| 59 |
+
|
| 60 |
+
|
| 61 |
Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
|
| 62 |
|
| 63 |
<!-- description end -->
|