ylacombe
/

w2v-bert-2.0

ylacombe commited on Jan 4

Commit

ad84cbf

•

1 Parent(s): 5afceab

Upload Wav2Vec2BERTForPreTraining

Files changed (1) hide show

config.json CHANGED Viewed

@@ -22,7 +22,7 @@
   "feat_quantizer_dropout": 0.0,
   "feature_projection_input_dim": 160,
   "final_dropout": 0.1,
-  "hidden_act": "gelu",
   "hidden_dropout": 0.0,
   "hidden_size": 1024,
   "initializer_range": 0.02,

   "feat_quantizer_dropout": 0.0,
   "feature_projection_input_dim": 160,
   "final_dropout": 0.1,
+  "hidden_act": "swish",
   "hidden_dropout": 0.0,
   "hidden_size": 1024,
   "initializer_range": 0.02,