Transformers
Back to all models
xlm-roberta-large
xlm-roberta-large
How to use this model directly from the
🤗/transformers library:
tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-large") model = AutoModel.from_pretrained("xlm-roberta-large")
attention_probs_dropout_prob:
0.1
finetuning_task:
null
hidden_act:
"gelu"
hidden_dropout_prob:
0.1
hidden_size:
1024
id2label:
{
"0": "LABEL_0",
"1": "LABEL_1"
}
initializer_range:
0.02
intermediate_size:
4096
is_decoder:
false
label2id:
{
"LABEL_0": 0,
"LABEL_1": 1
}
layer_norm_eps:
0.00001
max_position_embeddings:
514
num_attention_heads:
16
num_hidden_layers:
24
num_labels:
2
output_attentions:
false
output_hidden_states:
false
output_past:
true
pruned_heads:
{}
torchscript:
false
type_vocab_size:
1
use_bfloat16:
false
vocab_size:
250002