Text Generation
Transformers
PyTorch
English
llama
conversational
text-generation-inference
Mihaiii commited on
Commit
11d03c4
1 Parent(s): 2efc8ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -7,11 +7,12 @@ datasets:
7
  - HuggingFaceH4/ultrafeedback_binarized
8
  language:
9
  - en
 
10
  ---
11
 
12
  Optimum quantization using the command:
13
  ```bash
14
- !optimum-cli inc quantize --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 --output ./TinyLlama
15
  ```
16
 
17
  Usage example:
 
7
  - HuggingFaceH4/ultrafeedback_binarized
8
  language:
9
  - en
10
+ inference: false
11
  ---
12
 
13
  Optimum quantization using the command:
14
  ```bash
15
+ optimum-cli inc quantize --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 --output ./TinyLlama
16
  ```
17
 
18
  Usage example: