TheBloke commited on
Commit
8cf9fcc
1 Parent(s): e68657a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -199,9 +199,13 @@ print(pipe(prompt_template)[0]['generated_text'])
199
  <!-- README_GPTQ.md-compatibility start -->
200
  ## Compatibility
201
 
202
- The provided files have not yet been tested. They are expected to work with AutoGPTQ, or via Transformers, as long as Transformers 4.33.0 is installed, and AutoGPTQ is updated as described above.
203
 
204
- [Huggingface Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) is compatible with all GPTQ models, but hasn't yet been tested with these files. Let me know if it works!
 
 
 
 
205
  <!-- README_GPTQ.md-compatibility end -->
206
 
207
  <!-- footer start -->
 
199
  <!-- README_GPTQ.md-compatibility start -->
200
  ## Compatibility
201
 
202
+ The provided files have been tested with Transformers 4.33.0, and TGI 1.0.4.
203
 
204
+ Because they are sharded, they will not yet via AutoGPTQ. It is hoped support will be added soon.
205
+
206
+ Note: lack of support for AutoGPTQ doesn't affect your ability to load these models from Python code. It only affects third-party clients that might use AutoGPTQ.
207
+
208
+ [Huggingface Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) is confirmed working as of version 1.0.4.
209
  <!-- README_GPTQ.md-compatibility end -->
210
 
211
  <!-- footer start -->