results_G2

This model is a fine-tuned version of Sushant0809/results_G1 on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.2192
• Treatment: 0.9042
• Chronic: 0.9030
• Cancer: 0.8800
• Allergy: 0.8330
• Other: 0.9448
• Weighted Avg: 0.9253

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• num_epochs: 3

Training results

Training Loss	Epoch	Step	Validation Loss	Treatment	Chronic	Cancer	Allergy	Other	Weighted Avg
0.2471	0.3040	100	0.2212	0.9060	0.9058	0.8874	0.8314	0.9453	0.9268
0.2427	0.6079	200	0.2192	0.9042	0.9030	0.8800	0.8330	0.9448	0.9253
0.2382	0.9119	300	0.2203	0.9040	0.9052	0.8804	0.8124	0.9461	0.9262
0.1912	1.2158	400	0.2292	0.8987	0.9001	0.8861	0.8421	0.9454	0.9246
0.2118	1.5198	500	0.2262	0.8947	0.9006	0.8778	0.8004	0.9436	0.9220
0.1922	1.8237	600	0.2419	0.9021	0.8946	0.8734	0.8361	0.9438	0.9226
0.1604	2.1277	700	0.2764	0.9018	0.9001	0.8769	0.8435	0.9459	0.9249

Framework versions

• Transformers 4.41.2
• Pytorch 2.1.2
• Datasets 2.19.2
• Tokenizers 0.19.1