Intel
/

t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation

Intel® Neural Compressor

neural-compressor

PostTrainingDynamic

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

echarlaix HF staff commited on Mar 21

Commit

fded9fe

•

1 Parent(s): 37270a0

update loading instructions

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -29,8 +29,8 @@ The original fp32 model comes from the fine-tuned model [flax-community/t5-base-
 ### Load with optimum:
 ```python
-from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSeq2SeqLM
-int8_model = IncQuantizedModelForSeq2SeqLM.from_pretrained(
-    'Intel/t5-base-cnn-dm-int8-dynamic',
-)
 ```

 ### Load with optimum:
 ```python
+from optimum.intel import INCModelForSeq2SeqLM
+model_id = "Intel/t5-base-cnn-dm-int8-dynamic"
+int8_model = INCModelForSeq2SeqLM.from_pretrained(model_id)
 ```