iproskurina
/

distilbert-base-alternate-layers

Model card Files Files and versions Community

iproskurina commited on 25 days ago

Commit

8a287fb

•

1 Parent(s): 5b43e3f

Upload model

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
   "max_position_embeddings": 512,
   "model_type": "distilbert",
   "n_heads": 12,
-  "n_layers": 6,
   "output_past": true,
   "pad_token_id": 0,
   "qa_dropout": 0.1,

   "max_position_embeddings": 512,
   "model_type": "distilbert",
   "n_heads": 12,
+  "n_layers": 3,
   "output_past": true,
   "pad_token_id": 0,
   "qa_dropout": 0.1,