redscroll
/

Mistral-7B-v0.2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

redscroll commited on Apr 3

Commit

66fa895

•

1 Parent(s): 00713fd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ tokenizer = AutoTokenizer.from_pretrained("redscroll/Mistral-7B-v0.2")
 input_text = "In my younger and more vulnerable years"
-input_ids = tokenizer(input_text, return_tensors = "pt")
 outputs = model.generate(**input_ids, max_new_tokens = 500)

 input_text = "In my younger and more vulnerable years"
+input_ids = tokenizer(input_text, return_tensors = "pt").to("cuda")
 outputs = model.generate(**input_ids, max_new_tokens = 500)