zhili1990
/

myBert_init

Inference Endpoints

Model card Files Files and versions Community

zhili1990 commited on Jan 27

Commit

956fc8b

•

1 Parent(s): eea29ce

Upload config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -16,7 +16,7 @@
   "num_attention_heads": 12,
   "num_hidden_layers": 12,
   "pad_token_id": 0,
-  "position_embedding_type": "absolute",
   "torch_dtype": "float32",
   "transformers_version": "4.33.0",
   "type_vocab_size": 2,

   "num_attention_heads": 12,
   "num_hidden_layers": 12,
   "pad_token_id": 0,
+  "position_embedding_type": "absolute_rotary",
   "torch_dtype": "float32",
   "transformers_version": "4.33.0",
   "type_vocab_size": 2,