SChem5Labels-google-t5-v1_1-large-intra_model-dataset-frequency-human_annots_str-pairwise-mse

This model is a fine-tuned version of google/t5-v1_1-large on the None dataset. It achieves the following results on the evaluation set:

• Train Loss: 12.3131
• Loss: 11.1611
• Losses: [18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 128
• eval_batch_size: 128
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 200

Training results

Training Loss	Epoch	Step	Train Loss	Validation Loss	Losses
20.864	1.0	25	12.7247	25.2159	[18, 14, 10, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 10, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 14, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 11, 12, 15, 11, 13, 9, 11, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 9, 7, 12, 18, 9, 13, 11, 25, 13, 22, 9, 8, 14, 12, 9, 9, 24, 25, 12, 9, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 13, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 11, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 13, 13, 21, 12, 9, 9, 12, 12, 11, 12, 12, 11, 11, 9, 25, 9, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 12, 9, 8, 9, 23, 12, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
20.6583	2.0	50	12.7904	24.9669	[18, 14, 10, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 10, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 15, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 11, 12, 15, 11, 13, 9, 11, 23, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 14, 7, 12, 18, 9, 13, 11, 25, 13, 22, 9, 8, 15, 12, 9, 9, 27, 25, 12, 9, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 13, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 9, 11, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 15, 11, 12, 12, 25, 16, 11, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 11, 15, 14, 9, 12, 13, 13, 21, 12, 9, 9, 12, 14, 11, 12, 12, 11, 11, 9, 25, 9, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 12, 9, 9, 9, 23, 10, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
20.3473	3.0	75	12.7854	24.6459	[18, 14, 10, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 10, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 15, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 9, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 8, 12, 15, 11, 13, 9, 11, 23, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 18, 9, 13, 11, 25, 13, 22, 9, 8, 15, 12, 9, 9, 27, 25, 12, 9, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 13, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 10, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 15, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 13, 13, 21, 12, 19, 9, 12, 14, 11, 12, 12, 11, 11, 9, 25, 9, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 16, 22, 9, 12, 9, 9, 9, 23, 10, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
19.6804	4.0	100	12.6187	23.7945	[18, 14, 8, 9, 9, 9, 13, 9, 9, 17, 9, 14, 9, 9, 11, 9, 10, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 19, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 9, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 15, 42, 11, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 14, 9, 9, 13, 9, 15, 7, 9, 9, 15, 8, 9, 9, 10, 12, 14, 9, 8, 12, 17, 16, 11, 10, 9, 22, 15, 15, 11, 13, 9, 11, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 8, 12, 8, 9, 13, 13, 25, 13, 22, 12, 8, 15, 12, 9, 9, 27, 25, 12, 9, 9, 9, 8, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 9, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 9, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 8, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 10, 13, 9, 13, 10, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 15, 11, 12, 12, 25, 16, 12, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 12, 15, 14, 9, 12, 13, 13, 21, 12, 12, 9, 12, 14, 11, 12, 12, 11, 11, 9, 25, 9, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 16, 22, 9, 11, 9, 9, 9, 23, 10, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
18.9343	5.0	125	12.7298	19.5581	[18, 14, 9, 9, 9, 9, 13, 9, 12, 17, 9, 14, 9, 9, 11, 9, 7, 11, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 10, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 12, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 9, 12, 15, 42, 11, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 14, 9, 9, 13, 9, 9, 9, 9, 9, 15, 12, 9, 9, 17, 12, 14, 9, 8, 12, 17, 16, 11, 12, 9, 22, 15, 15, 14, 14, 9, 9, 9, 11, 13, 9, 11, 9, 7, 8, 21, 12, 14, 9, 13, 12, 7, 9, 23, 8, 9, 13, 9, 14, 8, 12, 9, 9, 13, 13, 25, 13, 22, 12, 8, 15, 12, 24, 9, 26, 25, 12, 9, 9, 9, 12, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 8, 25, 9, 9, 9, 15, 9, 13, 9, 17, 25, 25, 11, 13, 9, 9, 9, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 10, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 10, 15, 9, 22, 25, 13, 9, 10, 13, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 10, 13, 9, 13, 10, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 15, 11, 12, 12, 25, 16, 9, 9, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 14, 13, 21, 12, 14, 9, 12, 14, 11, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 15, 22, 9, 25, 9, 9, 9, 19, 12, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 11, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 8, 10, 9, 23, 17, 12, 9, 8, 10]
16.0724	6.0	150	12.3737	11.5288	[18, 14, 9, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 9, 11, 9, 8, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 7, 9, 18, 13, 16, 13, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 28, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 25, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 9, 12, 9, 13, 20, 20, 9, 9, 9, 15, 22, 9, 9, 17, 12, 14, 9, 7, 12, 12, 12, 11, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 11, 13, 9, 11, 9, 7, 8, 21, 12, 8, 9, 13, 12, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 26, 25, 12, 9, 12, 9, 22, 9, 10, 14, 9, 9, 12, 9, 20, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 11, 13, 9, 9, 9, 9, 9, 9, 9, 12, 9, 17, 13, 26, 9, 12, 12, 19, 12, 15, 12, 21, 9, 25, 13, 12, 12, 9, 10, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 11, 25, 9, 10, 9, 9, 12, 14, 9, 8, 8, 18, 17, 9, 9, 12, 9, 12, 9, 10, 14, 9, 13, 10, 18, 25, 14, 7, 13, 8, 18, 9, 18, 9, 14, 11, 14, 12, 12, 12, 9, 9, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 20, 9, 12, 13, 13, 21, 9, 11, 9, 12, 14, 7, 12, 12, 11, 11, 9, 25, 9, 11, 8, 12, 13, 9, 9, 9, 7, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 13, 9, 11, 9, 9, 9, 25, 10, 9, 25, 9, 12, 9, 14, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 9, 8, 10, 9, 23, 17, 12, 9, 9, 10]
14.9913	7.0	175	12.3131	11.1611	[18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]
14.8962	8.0	200	12.3131	11.1611	[18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]
14.9872	9.0	225	12.3131	11.1611	[18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]
14.9044	10.0	250	12.3131	11.1611	[18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]
14.828	11.0	275	12.3131	11.1611	[18, 14, 9, 9, 9, 9, 13, 8, 12, 9, 12, 14, 9, 9, 11, 9, 9, 8, 9, 12, 9, 18, 9, 18, 25, 9, 14, 9, 42, 12, 9, 9, 9, 9, 8, 9, 18, 13, 16, 14, 9, 9, 9, 13, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 18, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 18, 8, 9, 15, 9, 19, 9, 9, 12, 14, 9, 9, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 12, 21, 20, 12, 9, 13, 20, 15, 9, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 15, 12, 12, 12, 12, 12, 9, 9, 15, 15, 14, 14, 9, 9, 23, 12, 13, 9, 11, 9, 9, 8, 11, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 14, 11, 14, 15, 12, 9, 9, 14, 13, 25, 13, 22, 12, 9, 14, 12, 13, 9, 14, 25, 12, 9, 12, 9, 8, 9, 10, 18, 9, 9, 12, 9, 20, 25, 12, 12, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 9, 25, 9, 9, 9, 9, 14, 11, 9, 17, 12, 12, 12, 13, 9, 9, 9, 9, 9, 9, 7, 12, 9, 17, 13, 26, 9, 12, 12, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 9, 12, 11, 8, 9, 23, 10, 15, 12, 9, 9, 17, 14, 12, 10, 15, 9, 22, 9, 25, 9, 10, 9, 12, 12, 14, 9, 8, 12, 18, 17, 9, 9, 12, 9, 12, 9, 8, 14, 9, 13, 10, 18, 25, 14, 8, 13, 8, 33, 9, 18, 9, 14, 12, 14, 12, 12, 12, 16, 13, 9, 11, 9, 22, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 16, 15, 20, 7, 12, 13, 13, 16, 12, 18, 9, 12, 14, 11, 12, 12, 11, 13, 9, 25, 9, 11, 8, 12, 12, 9, 9, 9, 8, 9, 12, 25, 9, 12, 9, 12, 11, 9, 15, 16, 9, 25, 14, 9, 11, 13, 9, 12, 9, 9, 9, 25, 10, 9, 9, 9, 12, 9, 20, 9, 12, 9, 9, 9, 11, 9, 18, 16, 14, 12, 13, 15, 12, 9, 25, 9, 9, 9, 12, 8, 10, 9, 23, 8, 12, 9, 8, 10]

Framework versions

• Transformers 4.34.0
• Pytorch 2.1.0+cu121
• Datasets 2.14.5
• Tokenizers 0.14.1