underspirit
commited on
Commit
•
53d6bf7
1
Parent(s):
4c6095e
Update README.md
Browse files
README.md
CHANGED
@@ -117,7 +117,7 @@ The XVERSE-13B model can be loaded for inference using the following code:
|
|
117 |
>>> model = model.eval()
|
118 |
>>> inputs = tokenizer('北京的景点:故宫、天坛、万里长城等。\n深圳的景点:', return_tensors='pt').input_ids
|
119 |
>>> inputs = inputs.cuda()
|
120 |
-
>>> generated_ids = model.generate(inputs, max_new_tokens=64, eos_token_id=tokenizer.eos_token_id)
|
121 |
>>> print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True))
|
122 |
```
|
123 |
|
|
|
117 |
>>> model = model.eval()
|
118 |
>>> inputs = tokenizer('北京的景点:故宫、天坛、万里长城等。\n深圳的景点:', return_tensors='pt').input_ids
|
119 |
>>> inputs = inputs.cuda()
|
120 |
+
>>> generated_ids = model.generate(inputs, max_new_tokens=64, eos_token_id=tokenizer.eos_token_id, repetition_penalty=1.1)
|
121 |
>>> print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True))
|
122 |
```
|
123 |
|