Transformers
Back to all models
gpt2-xl
gpt2-xl
pytorch
tf
How to use this model directly from the
🤗/transformers library:
tokenizer = AutoTokenizer.from_pretrained("gpt2-xl") model = AutoModel.from_pretrained("gpt2-xl")
attn_pdrop:
0.1
embd_pdrop:
0.1
finetuning_task:
null
initializer_range:
0.02
is_decoder:
false
layer_norm_epsilon:
0.00001
n_ctx:
1024
n_embd:
1600
n_head:
25
n_layer:
48
n_positions:
1024
num_labels:
1
output_attentions:
false
output_hidden_states:
false
output_past:
true
pruned_heads:
{}
resid_pdrop:
0.1
summary_activation:
null
summary_first_dropout:
0.1
summary_proj_to_labels:
true
summary_type:
"cls_index"
summary_use_proj:
true
torchscript:
false
use_bfloat16:
false
vocab_size:
50257