mosaicml
/

mosaic-bert-base-seqlen-1024

Model card Files Files and versions Community

jacobfulano commited on Apr 28, 2023

Commit

aadf20a

•

1 Parent(s): 30fe9e5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ language:
 inference: false
 ---
-# MosaicBERT: mosaic-bert-base-seqlen-512 pretrained model
 MosaicBERT-Base is a new BERT architecture and training recipe optimized for fast pretraining.
 MosaicBERT trains faster and achieves higher pretraining and finetuning accuracy when benchmarked against

 inference: false
 ---
+# MosaicBERT: mosaic-bert-base-seqlen-1024 Pretrained Model
 MosaicBERT-Base is a new BERT architecture and training recipe optimized for fast pretraining.
 MosaicBERT trains faster and achieves higher pretraining and finetuning accuracy when benchmarked against