Update README.md
Browse files
README.md
CHANGED
@@ -199,9 +199,13 @@ print(pipe(prompt_template)[0]['generated_text'])
|
|
199 |
<!-- README_GPTQ.md-compatibility start -->
|
200 |
## Compatibility
|
201 |
|
202 |
-
The provided files have
|
203 |
|
204 |
-
|
|
|
|
|
|
|
|
|
205 |
<!-- README_GPTQ.md-compatibility end -->
|
206 |
|
207 |
<!-- footer start -->
|
|
|
199 |
<!-- README_GPTQ.md-compatibility start -->
|
200 |
## Compatibility
|
201 |
|
202 |
+
The provided files have been tested with Transformers 4.33.0, and TGI 1.0.4.
|
203 |
|
204 |
+
Because they are sharded, they will not yet via AutoGPTQ. It is hoped support will be added soon.
|
205 |
+
|
206 |
+
Note: lack of support for AutoGPTQ doesn't affect your ability to load these models from Python code. It only affects third-party clients that might use AutoGPTQ.
|
207 |
+
|
208 |
+
[Huggingface Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) is confirmed working as of version 1.0.4.
|
209 |
<!-- README_GPTQ.md-compatibility end -->
|
210 |
|
211 |
<!-- footer start -->
|