wenhuach commited on
Commit
acc1e1c
1 Parent(s): d455069

update readme

Browse files

Signed-off-by: wenhuach <wenhuach87@gmail.com>

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -26,7 +26,7 @@ model = AutoModelForCausalLM.from_pretrained(quantized_model_dir,
26
  tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
27
  text = "There is a girl who likes adventure,"
28
  inputs = tokenizer(text, return_tensors="pt").to(model.device)
29
- print(tokenizer.decode(model.generate(**inputs, max_new_tokens=50, do_sample=True)[0]))
30
  ##<bos>There is a girl who likes adventure, and she is a girl who likes to travel. She is a girl who likes to explore the world and see new things. She is a girl who likes to meet new people and learn about their cultures. She is a girl who likes to take risks
31
  ```
32
 
 
26
  tokenizer = AutoTokenizer.from_pretrained(quantized_model_dir, use_fast=True)
27
  text = "There is a girl who likes adventure,"
28
  inputs = tokenizer(text, return_tensors="pt").to(model.device)
29
+ print(tokenizer.decode(model.generate(**inputs, max_new_tokens=50)[0]))
30
  ##<bos>There is a girl who likes adventure, and she is a girl who likes to travel. She is a girl who likes to explore the world and see new things. She is a girl who likes to meet new people and learn about their cultures. She is a girl who likes to take risks
31
  ```
32