nomic-ai
/

nomic-bert-2048

Model card Files Files and versions Community

zpn commited on Jan 5

Commit

2a32621

•

1 Parent(s): 13e12b1

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -24,7 +24,7 @@
   "n_head": 12,
   "n_inner": 3072,
   "n_layer": 12,
-  "n_positions": 0,
   "pad_vocab_size_multiple": 64,
   "parallel_block": false,
   "parallel_block_tied_norm": false,

   "n_head": 12,
   "n_inner": 3072,
   "n_layer": 12,
+  "n_positions": 2048,
   "pad_vocab_size_multiple": 64,
   "parallel_block": false,
   "parallel_block_tied_norm": false,