Locutusque commited on
Commit
045ee35
1 Parent(s): 829c8a4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -100,8 +100,8 @@ def generate_text(model, tokenizer, prompt, max_length=1024):
100
  output = model.generate(input_ids,
101
  max_length=max_length,
102
  do_sample=True,
103
- top_k=50,
104
- top_p=0.30,
105
  pad_token_id=tokenizer.pad_token_id,
106
  eos_token_id=tokenizer.eos_token_id,
107
  attention_mask=attention_mask)
@@ -119,4 +119,4 @@ while True:
119
  print(output_text)
120
  ```
121
  ## Deploying and training the model
122
- The model has been fine-tuned on a specific input format that goes like this ```"<|SYSTEM|> {system prompt} <|USER|> {user prompt} <|ASSISTANT|> {model prediction} <|End|>".``` For the best performance from the model the input text should be as follows ```<|SYSTEM|> {system prompt} <|USER|> {user prompt} <|ASSISTANT|> ``` and the target/label should be as follows ```<|SYSTEM|> {system prompt} <|USER|> {user prompt} <|ASSISTANT|> {dataset output} <|End|>```
 
100
  output = model.generate(input_ids,
101
  max_length=max_length,
102
  do_sample=True,
103
+ top_k=35,
104
+ top_p=0.80,
105
  pad_token_id=tokenizer.pad_token_id,
106
  eos_token_id=tokenizer.eos_token_id,
107
  attention_mask=attention_mask)
 
119
  print(output_text)
120
  ```
121
  ## Deploying and training the model
122
+ The model has been fine-tuned on a specific input format that goes like this ```"<|USER|> {user prompt} <|ASSISTANT|> {model prediction} <|End|>".``` For the best performance from the model the input text should be as follows ```<|USER|> {user prompt} <|ASSISTANT|> ``` and the target/label should be as follows ```<|USER|> {user prompt} <|ASSISTANT|> {dataset output} <|End|>```