Transformers
Back to all models
bert-base-chinese
bert-base-chinese
pytorch
tf
How to use this model directly from the
🤗/transformers library:
tokenizer = AutoTokenizer.from_pretrained("bert-base-chinese") model = AutoModel.from_pretrained("bert-base-chinese")
attention_probs_dropout_prob:
0.1
directionality:
"bidi"
hidden_act:
"gelu"
hidden_dropout_prob:
0.1
hidden_size:
768
initializer_range:
0.02
intermediate_size:
3072
max_position_embeddings:
512
num_attention_heads:
12
num_hidden_layers:
12
pooler_fc_size:
768
pooler_num_attention_heads:
12
pooler_num_fc_layers:
3
pooler_size_per_head:
128
pooler_type:
"first_token_transform"
type_vocab_size:
2
vocab_size:
21128