pszemraj commited on
Commit
e5f3fba
1 Parent(s): c7382b6

add early_stopping and do_sample

Browse files

bc we are defaulting to multinomial beam sampling

Files changed (1) hide show
  1. generation_config.json +2 -0
generation_config.json CHANGED
@@ -4,6 +4,8 @@
4
  "eos_token_id": 0,
5
  "transformers_version": "4.28.1",
6
  "use_cache": false,
 
 
7
  "temperature": 0.1,
8
  "top_p": 0.75,
9
  "top_k": 40,
 
4
  "eos_token_id": 0,
5
  "transformers_version": "4.28.1",
6
  "use_cache": false,
7
+ "early_stopping": true,
8
+ "do_sample": true,
9
  "temperature": 0.1,
10
  "top_p": 0.75,
11
  "top_k": 40,