Local-Novel-LLM-project
/

Ninja-v1

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

umisetokikaze commited on May 4

Commit

f9e8abf

•

1 Parent(s): ef88650

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -74,7 +74,7 @@ system_prompt = "あなたはプロの小説家です。\n小説を書いてく
 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
-model_inputs = tokenizer([prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)

 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
+model_inputs = tokenizer([system_prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)