Local-Novel-LLM-project
/

Vecteus-Poet

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

umisetokikaze commited on May 4

Commit

9f264c1

•

1 Parent(s): c29a2be

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -72,7 +72,7 @@ system_prompt = "あなたはプロの小説家です。\n小説を書いてく
 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
-model_inputs = tokenizer([prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)

 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
+model_inputs = tokenizer([system_prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)