Tongjilibo commited on
Commit
d36613e
1 Parent(s): e3517e1

修改roberta-wmm的pad_id

Browse files
chinese-roberta-wwm-ext-large/bert4torch_config.json CHANGED
@@ -17,7 +17,7 @@
17
  "num_attention_heads": 16,
18
  "num_hidden_layers": 24,
19
  "output_past": true,
20
- "pad_token_id": 1,
21
  "pooler_fc_size": 768,
22
  "pooler_num_attention_heads": 12,
23
  "pooler_num_fc_layers": 3,
 
17
  "num_attention_heads": 16,
18
  "num_hidden_layers": 24,
19
  "output_past": true,
20
+ "pad_token_id": 0,
21
  "pooler_fc_size": 768,
22
  "pooler_num_attention_heads": 12,
23
  "pooler_num_fc_layers": 3,
chinese-roberta-wwm-ext/bert4torch_config.json CHANGED
@@ -17,7 +17,7 @@
17
  "num_attention_heads": 12,
18
  "num_hidden_layers": 12,
19
  "output_past": true,
20
- "pad_token_id": 1,
21
  "pooler_fc_size": 768,
22
  "pooler_num_attention_heads": 12,
23
  "pooler_num_fc_layers": 3,
 
17
  "num_attention_heads": 12,
18
  "num_hidden_layers": 12,
19
  "output_past": true,
20
+ "pad_token_id": 0,
21
  "pooler_fc_size": 768,
22
  "pooler_num_attention_heads": 12,
23
  "pooler_num_fc_layers": 3,