p1atdev
/

dart-v1-base

Text Generation

text-generation-inference

Model card Files Files and versions Community

p1atdev commited on Feb 22

Commit

59bc547

•

1 Parent(s): 289c297

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -111,7 +111,7 @@ inputs = tokenizer.apply_chat_template({
 }, tokenize=True)
 with torch.no_grad():
-  outputs = model.generate(inputs, generation_config=generation_config)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 ```

 }, tokenize=True)
 with torch.no_grad():
+  outputs = ort_model.generate(inputs, generation_config=generation_config)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 ```