videomae-base-zhe4

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1261
• Accuracy: 0.9574

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• training_steps: 3020

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
0.2379	0.0503	152	0.3985	0.8797
0.1818	1.0503	304	0.5347	0.8797
0.2034	2.0503	456	0.2859	0.9056
0.2066	3.0503	608	0.5684	0.8897
0.0707	4.0503	760	0.4417	0.9169
0.0527	5.0503	912	0.3840	0.8826
0.1549	6.0503	1064	0.4473	0.8926
0.1056	7.0503	1216	0.5321	0.8968
0.0306	8.0503	1368	0.5502	0.9185
0.0685	9.0503	1520	0.8039	0.8910
0.0368	10.0503	1672	0.6278	0.8901
0.0248	11.0503	1824	0.7270	0.8972
0.032	12.0503	1976	0.3589	0.8822
0.0024	13.0503	2128	0.6363	0.8897
0.038	14.0503	2280	0.7318	0.8914
0.0008	15.0503	2432	0.4481	0.9110
0.0011	16.0503	2584	0.1261	0.9574
0.0131	17.0503	2736	0.2465	0.9315
0.0025	18.0503	2888	0.1775	0.9227
0.0265	19.0437	3020	0.2130	0.9323

Framework versions

• Transformers 4.42.3
• Pytorch 2.3.0+cu121
• Datasets 2.20.0
• Tokenizers 0.19.1