krevas
/

finance-koelectra-small-discriminator

Transformers PyTorch Korean electra pretraining Inference Endpoints

Model card Files Files and versions Community

system HF staff commited on Jun 1, 2020

Commit

3eab0c5

•

1 Parent(s): 5e243e1

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
     "initializer_range": 0.02,
     "intermediate_size": 1024,
     "layer_norm_eps": 1e-12,
-    "max_position_embeddings": 64,
     "model_type": "electra",
     "num_attention_heads": 4,
     "num_hidden_layers": 12,

     "initializer_range": 0.02,
     "intermediate_size": 1024,
     "layer_norm_eps": 1e-12,
+    "max_position_embeddings": 128,
     "model_type": "electra",
     "num_attention_heads": 4,
     "num_hidden_layers": 12,