Locutusque commited on
Commit
43380ec
1 Parent(s): 7742090

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -31,6 +31,7 @@ inference:
31
  top_p: 0.34
32
  top_k: 30
33
  max_new_tokens: 250
 
34
  ---
35
  Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
36
  It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.
 
31
  top_p: 0.34
32
  top_k: 30
33
  max_new_tokens: 250
34
+ repetition_penalty: 1.15
35
  ---
36
  Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
37
  It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.