echarlaix HF staff commited on
Commit
57906db
1 Parent(s): 9418e53

update loading instructions

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -33,8 +33,8 @@ Below linear modules (21/133) are fallbacked to fp32 for less than 1% relative a
33
 
34
  ```python
35
  # transformers <= 4.23.0
36
- from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSeq2SeqLM
37
- int8_model = IncQuantizedModelForSeq2SeqLM.from_pretrained(
38
- 'Intel/distilbart-cnn-12-6-int8-dynamic',
39
- )
40
- ```
 
33
 
34
  ```python
35
  # transformers <= 4.23.0
36
+ from optimum.intel import INCModelForSeq2SeqLM
37
+
38
+ model_id = "Intel/distilbart-cnn-12-6-int8-dynamic"
39
+ int8_model = INCModelForSeq2SeqLM.from_pretrained(model_id)
40
+ ```