update loading instructions
Browse files
README.md
CHANGED
@@ -33,8 +33,8 @@ Below linear modules (21/133) are fallbacked to fp32 for less than 1% relative a
|
|
33 |
|
34 |
```python
|
35 |
# transformers <= 4.23.0
|
36 |
-
from optimum.intel
|
37 |
-
|
38 |
-
|
39 |
-
)
|
40 |
-
```
|
|
|
33 |
|
34 |
```python
|
35 |
# transformers <= 4.23.0
|
36 |
+
from optimum.intel import INCModelForSeq2SeqLM
|
37 |
+
|
38 |
+
model_id = "Intel/distilbart-cnn-12-6-int8-dynamic"
|
39 |
+
int8_model = INCModelForSeq2SeqLM.from_pretrained(model_id)
|
40 |
+
```
|