Transformers
Back to all models
Model: t5-3b

Monthly model downloads

t5-3b t5-3b
- downloads
last 30 days

pytorch

tf

How to use this model directly from the 🤗/transformers library:

			
Copy model
tokenizer = AutoTokenizer.from_pretrained("t5-3b") model = AutoModel.from_pretrained("t5-3b")

Config

See raw config file
d_ff: 16384 ...
d_kv: 128 ...
d_model: 1024 ...
dropout_rate: 0.1 ...
▾ finetuning_task: null ...
initializer_factor: 1 ...
is_decoder: false ...
layer_norm_epsilon: 0.000001 ...
n_positions: 512 ...
num_heads: 32 ...
num_labels: 2 ...
num_layers: 24 ...
output_attentions: false ...
output_hidden_states: false ...
output_past: true ...
▾ pruned_heads: {} ...
relative_attention_num_buckets: 32 ...
torchscript: false ...
use_bfloat16: false ...
vocab_size: 32128 ...