Q-bert
/

MambaHermes-3B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Q-bert commited on Dec 28, 2023

Commit

dc5deb2

·

1 Parent(s): 0173525

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -52,7 +52,7 @@ out = model.generate(
 decoded = tokenizer.batch_decode(out)
 assistant_message = (
-    decoded[0].split("<|assistant|>\n")[-1].replace(eos, "")
 )
 print(assistant_message)

 decoded = tokenizer.batch_decode(out)
 assistant_message = (
+    decoded[0].split("<|assistant|>\n")[-1].replace(tokenizer.eos_token, "")
 )
 print(assistant_message)