SChem5Labels-google-t5-v1_1-large-inter_model-frequency-human_annots_str-pairwise-mse-cycle2

This model is a fine-tuned version of google/t5-v1_1-large on the None dataset. It achieves the following results on the evaluation set:

• Train Loss: 12.8864
• Loss: 10.7317
• Losses: [18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 128
• eval_batch_size: 128
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 200

Training results

Training Loss	Epoch	Step	Train Loss	Validation Loss	Losses
20.7173	1.0	25	12.7424	24.5084	[18, 14, 10, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 7, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 10, 14, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 11, 12, 15, 11, 13, 9, 11, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 9, 7, 12, 18, 9, 13, 13, 25, 13, 22, 9, 8, 14, 12, 9, 9, 24, 25, 12, 9, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 13, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 11, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 13, 13, 21, 12, 9, 9, 12, 12, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 12, 9, 8, 9, 23, 12, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
20.6647	2.0	50	12.8460	24.3914	[18, 14, 10, 9, 9, 9, 13, 9, 12, 9, 9, 14, 9, 9, 11, 9, 7, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 10, 14, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 9, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 22, 12, 15, 11, 13, 9, 9, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 14, 7, 12, 18, 9, 13, 13, 25, 13, 22, 9, 8, 14, 12, 9, 9, 24, 25, 12, 9, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 9, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 25, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 14, 11, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 14, 13, 21, 12, 9, 9, 12, 18, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 25, 9, 8, 9, 23, 12, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
20.4346	3.0	75	12.8636	23.9937	[18, 14, 10, 9, 9, 9, 13, 9, 12, 14, 9, 14, 9, 9, 11, 9, 7, 12, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 11, 16, 9, 9, 9, 13, 9, 18, 12, 16, 13, 8, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 11, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 14, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 9, 9, 9, 10, 12, 14, 42, 7, 12, 17, 16, 11, 10, 9, 22, 12, 15, 11, 13, 9, 9, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 14, 7, 12, 18, 9, 13, 11, 25, 13, 22, 9, 8, 14, 12, 9, 9, 24, 25, 12, 9, 9, 9, 9, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 9, 25, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 9, 12, 9, 11, 22, 26, 9, 12, 9, 19, 11, 15, 12, 14, 9, 25, 13, 11, 12, 9, 8, 12, 12, 15, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 25, 9, 10, 13, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 10, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 9, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 9, 15, 14, 9, 12, 14, 13, 21, 9, 9, 9, 12, 12, 11, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 22, 9, 25, 9, 8, 9, 23, 12, 9, 25, 42, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
19.8166	4.0	100	12.7778	22.7369	[18, 14, 10, 9, 9, 9, 13, 9, 12, 14, 9, 14, 9, 9, 11, 9, 7, 12, 9, 8, 42, 17, 9, 18, 25, 9, 14, 9, 42, 11, 16, 9, 9, 9, 13, 9, 18, 13, 16, 13, 8, 9, 9, 9, 9, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 11, 12, 12, 9, 17, 8, 9, 25, 9, 19, 9, 10, 12, 14, 42, 11, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 9, 9, 9, 17, 12, 14, 9, 9, 12, 17, 16, 11, 10, 9, 22, 12, 15, 11, 13, 9, 9, 23, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 14, 9, 12, 9, 9, 13, 13, 25, 13, 22, 9, 8, 14, 12, 9, 9, 27, 25, 18, 9, 9, 9, 9, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 12, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 9, 9, 25, 9, 9, 9, 15, 9, 10, 9, 12, 12, 25, 11, 13, 9, 9, 9, 9, 9, 9, 9, 12, 9, 11, 22, 26, 9, 12, 8, 19, 11, 15, 12, 24, 9, 25, 13, 11, 12, 9, 8, 12, 12, 14, 9, 23, 10, 15, 12, 9, 15, 17, 14, 12, 10, 15, 9, 22, 25, 12, 9, 10, 9, 9, 12, 14, 9, 9, 8, 17, 17, 9, 9, 12, 9, 12, 9, 10, 13, 9, 13, 10, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 11, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 11, 15, 14, 9, 12, 14, 13, 21, 9, 21, 9, 12, 12, 16, 12, 12, 11, 11, 9, 25, 14, 11, 7, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 22, 9, 11, 9, 9, 9, 19, 12, 9, 25, 42, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
19.0708	5.0	125	12.4899	19.0103	[18, 14, 11, 11, 9, 9, 13, 9, 9, 17, 9, 14, 9, 9, 11, 9, 7, 8, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 10, 9, 9, 9, 13, 9, 28, 13, 16, 13, 8, 9, 9, 9, 9, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 12, 8, 12, 12, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 9, 9, 13, 9, 24, 7, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 7, 12, 12, 16, 11, 10, 9, 15, 12, 15, 11, 13, 9, 9, 23, 11, 13, 9, 11, 9, 9, 8, 21, 12, 8, 9, 13, 12, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 9, 13, 13, 25, 13, 22, 9, 8, 8, 12, 9, 9, 27, 25, 18, 9, 9, 9, 8, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 13, 25, 9, 9, 9, 9, 9, 13, 9, 17, 12, 25, 11, 13, 9, 9, 9, 9, 9, 9, 9, 12, 9, 17, 13, 26, 9, 12, 8, 19, 11, 15, 12, 24, 9, 25, 13, 11, 12, 9, 10, 12, 8, 14, 9, 23, 10, 15, 12, 9, 10, 17, 14, 9, 10, 18, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 9, 8, 17, 17, 9, 9, 12, 9, 12, 9, 9, 13, 9, 13, 10, 28, 25, 14, 13, 13, 13, 18, 9, 18, 9, 8, 11, 12, 12, 25, 16, 8, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 8, 8, 15, 14, 9, 12, 13, 13, 21, 9, 9, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 7, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 13, 9, 11, 9, 9, 9, 19, 12, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 11, 17, 12, 9, 25, 15, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
16.0391	6.0	150	12.7955	11.4037	[18, 14, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 9, 9, 8, 42, 17, 9, 18, 25, 11, 14, 9, 42, 12, 14, 9, 9, 9, 17, 9, 28, 13, 16, 13, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 12, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 20, 9, 9, 13, 20, 20, 8, 9, 9, 15, 20, 9, 9, 15, 12, 14, 9, 8, 12, 12, 16, 11, 10, 9, 22, 9, 15, 11, 14, 9, 9, 23, 11, 13, 9, 12, 9, 9, 8, 21, 12, 14, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 9, 8, 8, 12, 13, 9, 9, 25, 15, 9, 9, 9, 20, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 10, 14, 9, 12, 9, 13, 12, 9, 9, 13, 8, 13, 25, 9, 9, 9, 9, 14, 13, 9, 17, 12, 25, 11, 13, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 14, 9, 25, 13, 11, 12, 9, 10, 12, 29, 8, 9, 23, 10, 15, 12, 9, 10, 17, 14, 9, 9, 18, 9, 22, 10, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 9, 12, 9, 9, 13, 9, 9, 10, 28, 25, 14, 17, 13, 13, 18, 9, 18, 9, 8, 11, 12, 12, 25, 16, 17, 13, 9, 11, 9, 9, 9, 12, 13, 12, 12, 32, 8, 8, 9, 9, 8, 17, 15, 18, 9, 12, 13, 13, 21, 9, 14, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 8, 12, 13, 9, 9, 14, 17, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 9, 9, 11, 9, 9, 9, 19, 10, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 16, 14, 12, 11, 17, 12, 9, 25, 15, 9, 9, 9, 8, 10, 9, 23, 17, 12, 9, 8, 10]
14.6053	7.0	175	12.8864	10.7317	[18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
14.5213	8.0	200	12.8864	10.7317	[18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
14.4621	9.0	225	12.8864	10.7317	[18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
14.3259	10.0	250	12.8864	10.7317	[18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]
14.389	11.0	275	12.8864	10.7317	[18, 9, 11, 11, 9, 9, 13, 8, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 8, 42, 17, 9, 16, 25, 9, 14, 9, 42, 12, 14, 9, 9, 9, 9, 9, 28, 13, 16, 14, 8, 9, 9, 13, 7, 9, 12, 9, 9, 15, 22, 15, 12, 9, 9, 12, 12, 12, 12, 9, 25, 8, 9, 25, 9, 12, 12, 12, 9, 17, 8, 9, 25, 9, 20, 9, 10, 9, 8, 42, 11, 9, 23, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 9, 12, 9, 13, 20, 15, 8, 9, 9, 15, 8, 9, 9, 15, 12, 14, 42, 8, 12, 12, 16, 12, 10, 9, 9, 9, 15, 11, 10, 18, 9, 23, 11, 13, 9, 12, 9, 7, 9, 21, 12, 9, 9, 13, 12, 8, 9, 19, 8, 9, 13, 9, 14, 8, 9, 8, 9, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 8, 25, 12, 11, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 13, 9, 16, 14, 9, 12, 9, 13, 12, 42, 11, 13, 9, 28, 25, 9, 9, 9, 12, 14, 13, 9, 17, 12, 25, 12, 9, 9, 9, 9, 9, 9, 13, 9, 9, 9, 19, 9, 26, 9, 12, 10, 19, 11, 15, 13, 12, 9, 12, 13, 11, 12, 9, 10, 12, 11, 21, 9, 23, 10, 15, 12, 9, 10, 17, 14, 12, 9, 18, 9, 22, 17, 12, 9, 10, 9, 12, 12, 14, 9, 7, 8, 18, 17, 9, 9, 12, 18, 12, 9, 9, 13, 9, 11, 14, 28, 25, 9, 9, 13, 13, 18, 9, 18, 9, 8, 12, 12, 12, 25, 16, 16, 13, 9, 11, 9, 9, 42, 12, 13, 12, 12, 16, 8, 8, 9, 9, 8, 16, 15, 18, 9, 13, 13, 12, 12, 9, 18, 9, 12, 14, 16, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 14, 9, 9, 12, 25, 9, 12, 10, 12, 9, 9, 15, 16, 9, 25, 9, 9, 11, 9, 9, 11, 9, 9, 9, 19, 19, 9, 25, 42, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 9, 14, 12, 11, 17, 12, 11, 25, 9, 9, 9, 9, 9, 10, 9, 23, 17, 12, 9, 8, 10]

Framework versions

• Transformers 4.34.0
• Pytorch 2.1.0+cu121
• Datasets 2.14.5
• Tokenizers 0.14.1