Mihaiii
/

TinyLlama-1.1B-Chat-v1.0-optimum-intel

Text Generation

text-generation-inference

Model card Files Files and versions Community

Mihaiii commited on Jan 23

Commit

11d03c4

•

1 Parent(s): 2efc8ac

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -7,11 +7,12 @@ datasets:
 - HuggingFaceH4/ultrafeedback_binarized
 language:
 - en
 ---
 Optimum quantization using the command:
 ```bash
-!optimum-cli inc quantize --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 --output ./TinyLlama
 ```
 Usage example:

 - HuggingFaceH4/ultrafeedback_binarized
 language:
 - en
+inference: false
 ---
 Optimum quantization using the command:
 ```bash
+optimum-cli inc quantize --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 --output ./TinyLlama
 ```
 Usage example: