roberta-large_MBTI_N_MBTI_agg_balanced_75

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 4.3486
• F1: 0.6327
• Threshold: 0.53
• F1 At 05: 0.6292

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• distributed_type: multi-GPU
• num_devices: 4
• total_train_batch_size: 64
• total_eval_batch_size: 64
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 400
• num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	F1	Threshold	F1 At 05
2.1332	0.3509	200	2.7490	0.5346	0.4500	0.5228
2.0414	0.7018	400	2.6748	0.5587	0.71	0.4979
1.8854	1.0526	600	2.5903	0.5925	0.48	0.5854
1.6386	1.4035	800	2.2991	0.6221	0.4400	0.6125
1.6695	1.7544	1000	2.3011	0.6341	0.39	0.6155
1.3443	2.1053	1200	2.4711	0.6494	0.4200	0.6370
1.1930	2.4561	1400	2.7080	0.6354	0.4	0.6277
1.2307	2.8070	1600	3.2336	0.6299	0.73	0.6035
0.8067	3.1579	1800	3.2599	0.6319	0.64	0.6274
0.7089	3.5088	2000	3.7890	0.6324	0.59	0.6297
0.7426	3.8596	2200	3.7592	0.6294	0.75	0.6195
0.5747	4.2105	2400	3.9682	0.6357	0.32	0.6230
0.5576	4.5614	2600	4.3210	0.6334	0.52	0.6329
0.5344	4.9123	2800	4.3486	0.6327	0.53	0.6292

Framework versions

• Transformers 5.3.0
• Pytorch 2.7.1
• Datasets 4.8.5
• Tokenizers 0.22.2