ecdouglas commited on
Commit
c8249c3
1 Parent(s): 4ba3d44

Update json.config to account for beginning and end of document tokens

Browse files

Currently, this model fails when you pass it a token length of 514 and set truncation=True, because two additional tokens are added (beginning and end of document). Truncating input strings at 512 will prevent this error from occuring.

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -24,7 +24,7 @@
24
  "positive": 2
25
  },
26
  "layer_norm_eps": 1e-05,
27
- "max_position_embeddings": 514,
28
  "model_type": "roberta",
29
  "num_attention_heads": 12,
30
  "num_hidden_layers": 12,
 
24
  "positive": 2
25
  },
26
  "layer_norm_eps": 1e-05,
27
+ "max_position_embeddings": 512,
28
  "model_type": "roberta",
29
  "num_attention_heads": 12,
30
  "num_hidden_layers": 12,