Hugging Face's logo

mosaicml
/
mosaic-bert-base-seqlen-1024

Fill-Mask
Transformers
PyTorch
English
bert
custom_code
Model card Files Community
5
mosaic-bert-base-seqlen-1024

Commit History

Clarify how to load model in README
d6f27fe

jacobfulano commited on

Change attention_probs_dropout_prob to 0.1 so that triton FlashAttention dependencies are avoided
3bb233a

jacobfulano commited on

Update config so that alibi_starting_size is explicitly set to 1024
e4c6e65

jacobfulano commited on

Update README.md
90b5eb2

jacobfulano commited on

Update README.md
086b093

jacobfulano commited on

Update README.md
2fd269e

jacobfulano commited on

Upload BertForMaskedLM
e5dabf8

jacobfulano commited on

Update README.md
4ce1645

jacobfulano commited on

Update README.md
aadf20a

jacobfulano commited on

Create README.md
30fe9e5

jacobfulano commited on

Upload BertForMaskedLM
a76db42

jacobfulano commited on

initial commit
827771f

jacobfulano commited on