Transformers
Back to all models
Model: t5-small

Monthly model downloads

t5-small t5-small
- downloads
last 30 days

pytorch

tf

How to use this model directly from the 🤗/transformers library:

			
Copy model
tokenizer = AutoTokenizer.from_pretrained("t5-small") model = AutoModel.from_pretrained("t5-small")

Config

See raw config file
d_ff: 2048 ...
d_kv: 64 ...
d_model: 512 ...
dropout_rate: 0.1 ...
▾ finetuning_task: null ...
initializer_factor: 1 ...
is_decoder: false ...
layer_norm_epsilon: 0.000001 ...
n_positions: 512 ...
num_heads: 8 ...
num_labels: 2 ...
num_layers: 6 ...
output_attentions: false ...
output_hidden_states: false ...
output_past: true ...
▾ pruned_heads: {} ...
relative_attention_num_buckets: 32 ...
torchscript: false ...
use_bfloat16: false ...
vocab_size: 32128 ...