SChem5Labels-google-t5-v1_1-large-inter_model-dataset-frequency-model_annots_str-pairwise-mse

This model is a fine-tuned version of google/t5-v1_1-large on the None dataset. It achieves the following results on the evaluation set:

• Train Loss: 12.6853
• Loss: 10.8788
• Losses: [18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 128
• eval_batch_size: 128
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 200

Training results

Training Loss	Epoch	Step	Train Loss	Validation Loss	Losses
19.9698	1.0	25	12.632	24.1183	[18, 14, 10, 9, 9, 9, 13, 12, 9, 9, 14, 9, 9, 11, 9, 10, 12, 9, 8, 42, 17, 9, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 16, 13, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 9, 17, 8, 9, 25, 9, 9, 10, 10, 14, 42, 11, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 16, 11, 10, 9, 11, 12, 15, 11, 13, 9, 11, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 9, 7, 12, 18, 9, 13, 11, 25, 13, 22, 9, 8, 14, 12, 9, 9, 24, 25, 12, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 9, 10, 14, 9, 9, 13, 12, 9, 9, 13, 9, 13, 9, 9, 9, 15, 9, 10, 9, 12, 25, 25, 11, 13, 9, 9, 13, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 9, 14, 9, 12, 13, 13, 21, 12, 9, 12, 12, 16, 12, 12, 11, 11, 9, 25, 9, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 12, 9, 8, 9, 23, 12, 9, 25, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
19.7997	2.0	50	12.592	24.0682	[18, 14, 11, 9, 9, 9, 13, 12, 9, 9, 14, 9, 9, 11, 9, 7, 8, 9, 8, 42, 17, 9, 25, 11, 14, 9, 42, 12, 16, 9, 9, 9, 13, 9, 18, 16, 13, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 9, 17, 8, 9, 25, 9, 9, 10, 10, 14, 42, 11, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 12, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 42, 7, 12, 16, 11, 10, 9, 22, 12, 15, 11, 13, 9, 11, 9, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 15, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 9, 13, 11, 25, 13, 22, 9, 8, 14, 12, 9, 9, 27, 25, 12, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 9, 10, 14, 9, 9, 13, 12, 9, 9, 13, 9, 13, 9, 9, 9, 15, 9, 10, 9, 12, 12, 25, 11, 13, 9, 9, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 8, 19, 11, 15, 12, 14, 9, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 9, 8, 13, 9, 13, 18, 25, 14, 13, 13, 17, 18, 9, 18, 9, 14, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 42, 12, 13, 12, 12, 32, 8, 9, 9, 9, 9, 14, 9, 12, 13, 13, 21, 12, 9, 12, 12, 11, 12, 12, 11, 11, 9, 25, 14, 11, 9, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 12, 14, 9, 15, 22, 9, 12, 9, 9, 9, 23, 10, 9, 25, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 8, 10]
20.2003	3.0	75	12.5227	23.7999	[18, 14, 10, 9, 9, 9, 13, 12, 9, 9, 14, 9, 9, 11, 9, 10, 9, 9, 8, 42, 17, 9, 25, 11, 14, 9, 42, 12, 10, 9, 9, 9, 13, 9, 18, 16, 13, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 12, 24, 9, 12, 12, 9, 17, 8, 9, 25, 9, 9, 10, 13, 15, 42, 11, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 10, 9, 9, 13, 9, 9, 7, 9, 9, 15, 7, 9, 9, 10, 12, 14, 9, 7, 12, 16, 11, 10, 9, 22, 12, 15, 11, 13, 9, 9, 23, 11, 13, 9, 11, 9, 9, 9, 21, 12, 14, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 9, 13, 11, 25, 13, 22, 9, 8, 15, 12, 9, 9, 24, 25, 12, 9, 9, 7, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 9, 10, 14, 9, 9, 13, 12, 9, 9, 13, 9, 13, 9, 9, 9, 15, 9, 11, 9, 12, 12, 25, 11, 13, 9, 9, 9, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 10, 19, 11, 15, 12, 14, 9, 13, 11, 12, 9, 8, 12, 8, 15, 9, 23, 10, 15, 9, 15, 17, 14, 12, 10, 15, 9, 22, 11, 12, 9, 10, 9, 9, 12, 14, 9, 8, 8, 17, 17, 9, 9, 12, 9, 12, 19, 8, 13, 9, 13, 18, 25, 14, 13, 12, 17, 18, 9, 18, 9, 15, 11, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 9, 14, 9, 12, 13, 13, 21, 12, 9, 12, 12, 11, 12, 12, 11, 11, 9, 25, 14, 11, 7, 12, 13, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 15, 22, 9, 12, 9, 20, 9, 23, 10, 9, 25, 12, 9, 14, 8, 12, 9, 9, 9, 12, 9, 18, 16, 13, 12, 13, 17, 12, 25, 15, 9, 9, 9, 8, 10, 9, 23, 25, 12, 9, 8, 10]
19.1924	4.0	100	12.6693	22.6756	[18, 14, 11, 9, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 11, 9, 9, 8, 42, 17, 9, 25, 11, 14, 9, 42, 12, 14, 9, 9, 9, 13, 9, 18, 16, 13, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 8, 12, 8, 9, 24, 9, 12, 12, 9, 17, 8, 9, 25, 9, 9, 10, 9, 10, 42, 11, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 14, 9, 9, 13, 9, 20, 7, 9, 9, 15, 9, 9, 9, 11, 12, 14, 9, 7, 12, 16, 19, 10, 9, 22, 23, 15, 14, 13, 9, 9, 23, 11, 13, 9, 11, 9, 8, 9, 21, 12, 8, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 9, 7, 12, 18, 9, 13, 13, 25, 13, 22, 12, 8, 10, 12, 13, 9, 24, 25, 12, 9, 9, 9, 9, 10, 14, 9, 9, 10, 9, 9, 25, 12, 9, 10, 14, 9, 9, 13, 12, 9, 9, 13, 9, 13, 9, 9, 9, 15, 9, 11, 9, 12, 25, 25, 19, 13, 9, 9, 13, 9, 9, 9, 12, 9, 16, 22, 26, 9, 12, 9, 19, 11, 15, 12, 14, 9, 13, 11, 12, 9, 8, 12, 8, 12, 9, 23, 10, 15, 9, 11, 17, 14, 12, 10, 15, 9, 22, 14, 12, 9, 10, 9, 11, 12, 14, 9, 8, 8, 17, 19, 9, 9, 12, 9, 12, 19, 8, 13, 9, 13, 18, 25, 14, 13, 12, 17, 18, 9, 18, 9, 10, 19, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 32, 8, 9, 9, 9, 9, 13, 9, 12, 13, 13, 21, 9, 9, 12, 14, 11, 14, 12, 11, 11, 9, 25, 14, 11, 9, 12, 9, 9, 9, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 22, 9, 12, 9, 20, 9, 23, 10, 9, 25, 12, 9, 8, 8, 12, 9, 9, 9, 12, 9, 18, 16, 14, 12, 11, 17, 12, 25, 15, 9, 9, 9, 9, 10, 9, 23, 25, 12, 9, 9, 10]
18.3095	5.0	125	12.4747	19.7577	[18, 18, 9, 9, 9, 9, 13, 9, 15, 9, 14, 9, 9, 11, 9, 11, 9, 9, 8, 42, 17, 9, 25, 11, 14, 9, 42, 12, 14, 9, 9, 9, 13, 9, 18, 16, 12, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 21, 12, 12, 12, 12, 9, 12, 8, 20, 24, 9, 12, 12, 9, 17, 8, 9, 25, 9, 9, 10, 9, 15, 42, 9, 16, 9, 11, 9, 12, 9, 12, 13, 25, 18, 20, 17, 21, 9, 9, 9, 13, 9, 15, 7, 9, 9, 15, 8, 9, 9, 17, 12, 14, 9, 7, 12, 16, 19, 10, 9, 22, 10, 15, 14, 13, 9, 9, 9, 11, 13, 9, 10, 9, 8, 8, 21, 12, 8, 9, 13, 17, 7, 9, 19, 8, 9, 13, 9, 9, 7, 12, 9, 9, 13, 13, 25, 13, 22, 12, 8, 15, 12, 13, 9, 25, 25, 12, 9, 9, 8, 25, 10, 14, 9, 9, 10, 9, 9, 25, 12, 9, 10, 14, 9, 9, 9, 12, 9, 9, 9, 8, 12, 9, 9, 9, 9, 9, 9, 9, 17, 12, 25, 19, 13, 9, 9, 13, 9, 9, 9, 9, 9, 16, 22, 23, 9, 12, 9, 19, 11, 13, 12, 9, 9, 13, 11, 12, 9, 8, 12, 8, 8, 9, 23, 10, 15, 9, 11, 17, 14, 12, 10, 15, 9, 22, 10, 25, 9, 10, 9, 11, 12, 14, 9, 8, 8, 18, 17, 9, 9, 12, 9, 12, 19, 9, 13, 9, 9, 18, 25, 14, 13, 12, 13, 18, 9, 18, 9, 15, 19, 12, 12, 25, 16, 9, 13, 9, 12, 9, 9, 9, 12, 13, 12, 12, 13, 7, 8, 9, 9, 9, 14, 9, 9, 10, 12, 21, 9, 9, 12, 14, 16, 9, 12, 11, 11, 9, 25, 9, 11, 9, 12, 9, 9, 9, 9, 13, 9, 9, 25, 9, 12, 9, 12, 9, 9, 15, 16, 9, 25, 14, 9, 16, 22, 9, 12, 9, 15, 9, 23, 16, 9, 25, 12, 9, 9, 8, 12, 9, 9, 9, 12, 9, 18, 22, 14, 12, 11, 23, 12, 25, 9, 12, 9, 9, 9, 10, 9, 23, 17, 12, 9, 9, 10]
16.269	6.0	150	12.8053	12.0449	[18, 18, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 25, 11, 14, 9, 42, 12, 34, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 15, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 28, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 25, 18, 20, 17, 21, 21, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 17, 16, 14, 9, 7, 12, 16, 19, 10, 9, 15, 15, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 8, 9, 13, 17, 12, 9, 19, 8, 9, 13, 9, 14, 7, 12, 8, 12, 13, 13, 25, 13, 22, 12, 8, 8, 12, 9, 9, 11, 25, 12, 12, 9, 20, 25, 10, 14, 9, 9, 10, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 9, 11, 9, 12, 9, 9, 9, 12, 9, 9, 18, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 9, 9, 10, 22, 19, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 8, 9, 23, 10, 15, 9, 11, 17, 14, 12, 10, 15, 9, 22, 17, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 14, 12, 9, 12, 9, 7, 13, 9, 9, 18, 25, 14, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 8, 13, 9, 25, 12, 9, 9, 12, 9, 12, 12, 25, 8, 23, 9, 9, 8, 9, 9, 13, 10, 13, 17, 9, 9, 12, 14, 14, 12, 12, 11, 9, 9, 25, 9, 11, 8, 12, 9, 9, 8, 9, 13, 9, 12, 25, 9, 12, 9, 12, 9, 12, 15, 16, 8, 25, 14, 9, 16, 22, 9, 12, 9, 17, 9, 19, 15, 9, 25, 12, 9, 9, 9, 12, 9, 9, 9, 12, 9, 18, 16, 14, 12, 13, 23, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 8, 12, 9, 9, 10]
14.8649	7.0	175	12.6853	10.8788	[18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]
14.7746	8.0	200	12.6853	10.8788	[18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]
14.7766	9.0	225	12.6853	10.8788	[18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]
14.777	10.0	250	12.6853	10.8788	[18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]
14.7424	11.0	275	12.6853	10.8788	[18, 14, 15, 11, 9, 9, 13, 9, 9, 9, 14, 9, 9, 11, 9, 9, 25, 9, 12, 42, 17, 9, 9, 9, 14, 9, 42, 12, 28, 9, 9, 9, 13, 9, 18, 16, 9, 9, 9, 9, 8, 9, 12, 9, 9, 15, 22, 12, 12, 9, 7, 12, 12, 12, 12, 9, 25, 8, 20, 10, 9, 12, 12, 9, 17, 9, 9, 15, 9, 9, 10, 9, 8, 42, 9, 16, 9, 11, 9, 12, 19, 12, 13, 12, 18, 20, 17, 21, 20, 9, 9, 13, 20, 15, 8, 9, 9, 15, 20, 9, 9, 15, 16, 14, 9, 7, 12, 16, 19, 12, 9, 22, 9, 15, 13, 9, 9, 9, 9, 11, 13, 9, 12, 9, 9, 9, 21, 12, 9, 9, 13, 17, 7, 9, 23, 8, 9, 13, 9, 14, 7, 12, 8, 12, 14, 11, 25, 13, 22, 12, 8, 8, 12, 9, 9, 15, 25, 12, 9, 9, 20, 25, 10, 14, 9, 9, 12, 9, 20, 25, 12, 9, 10, 14, 9, 9, 11, 12, 9, 14, 11, 9, 12, 9, 9, 9, 12, 14, 11, 9, 17, 12, 25, 19, 13, 9, 12, 9, 9, 9, 15, 12, 9, 10, 22, 26, 9, 12, 10, 19, 11, 20, 12, 9, 9, 13, 11, 12, 9, 9, 12, 8, 11, 9, 23, 10, 15, 9, 11, 17, 14, 9, 10, 15, 9, 22, 18, 25, 9, 10, 9, 11, 12, 14, 9, 8, 12, 18, 17, 9, 20, 12, 9, 12, 9, 8, 14, 9, 13, 18, 25, 9, 13, 13, 9, 18, 9, 18, 9, 8, 19, 12, 12, 25, 16, 9, 13, 9, 25, 12, 22, 9, 12, 8, 12, 12, 25, 8, 23, 9, 9, 9, 13, 7, 9, 10, 13, 12, 9, 9, 12, 14, 14, 21, 12, 11, 9, 9, 25, 12, 11, 8, 12, 9, 9, 9, 9, 13, 9, 12, 9, 9, 12, 9, 12, 9, 12, 15, 16, 9, 25, 9, 9, 16, 22, 9, 12, 9, 20, 9, 19, 15, 9, 25, 12, 9, 9, 8, 12, 9, 14, 9, 12, 9, 18, 16, 9, 12, 7, 15, 12, 25, 15, 12, 9, 12, 9, 10, 9, 23, 9, 12, 9, 9, 10]

Framework versions

• Transformers 4.34.0
• Pytorch 2.1.0+cu121
• Datasets 2.14.5
• Tokenizers 0.14.1