johngiorgi commited on
Commit
bd01102
1 Parent(s): 550385a

Add trigram block by default

Browse files

Similar to PRIMERA-multinews and PRIMERA-multixscience, I have found that I get ROUGE scores much closer to those reported if I add a trigram block. I am proposing this be enabled by default in the HuggingFace config.

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -73,6 +73,7 @@
73
  "model_type": "led",
74
  "normalize_before": false,
75
  "normalize_embedding": true,
 
76
  "num_hidden_layers": 12,
77
  "output_past": false,
78
  "pad_token_id": 1,
73
  "model_type": "led",
74
  "normalize_before": false,
75
  "normalize_embedding": true,
76
+ "no_repeat_ngram_size": 3,
77
  "num_hidden_layers": 12,
78
  "output_past": false,
79
  "pad_token_id": 1,