OxxoCodes
/

distil-longformer-base-4096

Inference Endpoints

Model card Files Files and versions Community

OxxoCodes commited on Jun 15, 2023

Commit

97672bf

•

1 Parent(s): 1160401

Update config.json

Files changed (1) hide show

config.json +2 -2

config.json CHANGED Viewed

@@ -27,8 +27,8 @@
     "layer_norm_eps": 1e-05,
     "max_position_embeddings": 4098,
     "model_type": "longformer",
-    "num_attention_heads": 6,
-    "num_hidden_layers": 12,
     "pad_token_id": 1,
     "sep_token_id": 2,
     "type_vocab_size": 1,

     "layer_norm_eps": 1e-05,
     "max_position_embeddings": 4098,
     "model_type": "longformer",
+    "num_attention_heads": 12,
+    "num_hidden_layers": 6,
     "pad_token_id": 1,
     "sep_token_id": 2,
     "type_vocab_size": 1,