google-bert/bert-base-cased

Fill-Mask • Updated Feb 19 • 4.96M • 217

Note Base BERT model, smaller variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. 12-layer, 768-hidden, 12-heads , 110M parameters

google-bert/bert-base-uncased

Fill-Mask • Updated Feb 19 • 50M • 1.52k

Note Base BERT model, smaller variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. 12-layer, 768-hidden, 12-heads , 110M parameters

google-bert/bert-large-cased

Fill-Mask • Updated Feb 19 • 525k • 20

Note Large BERT model, larger variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-large-uncased

Fill-Mask • Updated Feb 19 • 1.43M • 87

Note Large BERT model, larger variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-base-multilingual-cased

Fill-Mask • Updated Feb 19 • 3.28M • 339

Note Base BERT model, smaller variant. The list of supported languages is available here: https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages 104 languages, 12-layer, 768-hidden, 12-heads, 110M parameters

google-bert/bert-base-chinese

Fill-Mask • Updated Feb 19 • 4.45M • 803

Note Base BERT model, smaller variant. Chinese Simplified and Traditional, 12-layer, 768-hidden, 12-heads, 110M parameters

google-bert/bert-large-cased-whole-word-masking

Fill-Mask • Updated 18 days ago • 2.1k • 13

Note Large BERT model, larger variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. Whole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-large-uncased-whole-word-masking

Fill-Mask • Updated Feb 19 • 20.7k • 17

Note Large BERT model, larger variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. Whole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models. 24-layer, 1024-hidden, 16-heads, 340M parameters