Edit model card

vit-msn-small-finetuned-alzheimers

This model is a fine-tuned version of facebook/vit-msn-small on the imagefolder dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0160
  • Accuracy: 0.9969

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 64
  • eval_batch_size: 64
  • seed: 42
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 256
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 50

Training results

Training Loss Epoch Step Validation Loss Accuracy
0.2996 0.9778 22 0.3897 0.8438
0.3703 2.0 45 0.3595 0.8594
0.3087 2.9778 67 0.3777 0.8625
0.486 4.0 90 0.4530 0.8187
0.3307 4.9778 112 0.4560 0.8234
0.306 6.0 135 0.3471 0.8672
0.3005 6.9778 157 0.3025 0.8859
0.319 8.0 180 0.2451 0.8984
0.3489 8.9778 202 0.1814 0.9281
0.3251 10.0 225 0.2451 0.9156
0.3034 10.9778 247 0.1566 0.9406
0.2746 12.0 270 0.2493 0.8922
0.2369 12.9778 292 0.1622 0.9375
0.2231 14.0 315 0.1781 0.9359
0.2281 14.9778 337 0.1268 0.9531
0.2001 16.0 360 0.2431 0.9141
0.183 16.9778 382 0.1017 0.9625
0.1891 18.0 405 0.1802 0.9391
0.1862 18.9778 427 0.0869 0.9766
0.1935 20.0 450 0.1079 0.9688
0.1797 20.9778 472 0.1250 0.9563
0.1605 22.0 495 0.0655 0.9719
0.1848 22.9778 517 0.0806 0.9766
0.1498 24.0 540 0.1116 0.9578
0.1394 24.9778 562 0.0807 0.9672
0.1584 26.0 585 0.0525 0.9797
0.1302 26.9778 607 0.0513 0.9828
0.1356 28.0 630 0.0420 0.9875
0.1101 28.9778 652 0.0354 0.9875
0.1227 30.0 675 0.0583 0.9766
0.1158 30.9778 697 0.0253 0.9906
0.117 32.0 720 0.0231 0.9906
0.1022 32.9778 742 0.0726 0.9797
0.1221 34.0 765 0.0160 0.9969
0.0956 34.9778 787 0.0482 0.9844
0.0856 36.0 810 0.0256 0.9875
0.0996 36.9778 832 0.0211 0.9906
0.0848 38.0 855 0.0446 0.9797
0.1001 38.9778 877 0.0274 0.9875
0.0976 40.0 900 0.0225 0.9922
0.0864 40.9778 922 0.0207 0.9922
0.0865 42.0 945 0.0193 0.9969
0.0773 42.9778 967 0.0203 0.9922
0.075 44.0 990 0.0131 0.9969
0.0761 44.9778 1012 0.0129 0.9938
0.0624 46.0 1035 0.0114 0.9969
0.0557 46.9778 1057 0.0102 0.9953
0.0708 48.0 1080 0.0116 0.9953
0.0667 48.8889 1100 0.0131 0.9953

Framework versions

  • Transformers 4.40.0
  • Pytorch 2.2.1+cu121
  • Datasets 2.19.0
  • Tokenizers 0.19.1
Downloads last month
11
Safetensors
Model size
21.7M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for rhlc/vit-msn-small-finetuned-alzheimers

Finetuned
(3)
this model

Evaluation results