mrm8488
/

limstral-7B-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mrm8488 commited on Nov 1, 2023

Commit

8b48ae4

•

1 Parent(s): 8738f54

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -80,7 +80,7 @@ model.resize_token_embeddings(len(tokenizer))
 gen = pipeline("text-generation", model=model, tokenizer=tokenizer, device=0)
-instruction = "[INST] Write a email to day goodbye to me boss [\INST]"
 res = gen(instruction, max_new_tokens=512, temperature=0.3, top_p=0.75, top_k=40, repetition_penalty=1.2)
 print(res[0]['generated_text'])
 ```

 gen = pipeline("text-generation", model=model, tokenizer=tokenizer, device=0)
+instruction = "[INST] Write an email to say goodbye to me boss [\INST]"
 res = gen(instruction, max_new_tokens=512, temperature=0.3, top_p=0.75, top_k=40, repetition_penalty=1.2)
 print(res[0]['generated_text'])
 ```