|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
base_model: facebook/convnextv2-tiny-1k-224 |
|
tags: |
|
- image-classification |
|
- vision |
|
- generated_from_trainer |
|
metrics: |
|
- accuracy |
|
model-index: |
|
- name: convnextv2-tiny-1k-224-text |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# convnextv2-tiny-1k-224-text |
|
|
|
This model is a fine-tuned version of [facebook/convnextv2-tiny-1k-224](https://huggingface.co/facebook/convnextv2-tiny-1k-224) on the davanstrien/zenodo-presentations-open-labels dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.4554 |
|
- Accuracy: 0.7874 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 2e-05 |
|
- train_batch_size: 64 |
|
- eval_batch_size: 64 |
|
- seed: 1337 |
|
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments |
|
- lr_scheduler_type: linear |
|
- num_epochs: 200.0 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Accuracy | |
|
|:-------------:|:-----:|:----:|:---------------:|:--------:| |
|
| 0.5242 | 1.0 | 23 | 0.4961 | 0.7559 | |
|
| 0.459 | 2.0 | 46 | 0.5001 | 0.7638 | |
|
| 0.4429 | 3.0 | 69 | 0.4554 | 0.7874 | |
|
| 0.4308 | 4.0 | 92 | 0.4924 | 0.7638 | |
|
| 0.4319 | 5.0 | 115 | 0.4673 | 0.7874 | |
|
| 0.4047 | 6.0 | 138 | 0.4930 | 0.7756 | |
|
| 0.425 | 7.0 | 161 | 0.4739 | 0.7795 | |
|
| 0.4102 | 8.0 | 184 | 0.5118 | 0.7598 | |
|
| 0.3959 | 9.0 | 207 | 0.5490 | 0.7480 | |
|
| 0.365 | 10.0 | 230 | 0.5261 | 0.7638 | |
|
| 0.4214 | 11.0 | 253 | 0.5089 | 0.7795 | |
|
| 0.3798 | 12.0 | 276 | 0.4711 | 0.7992 | |
|
| 0.3906 | 13.0 | 299 | 0.5035 | 0.7913 | |
|
| 0.3706 | 14.0 | 322 | 0.4933 | 0.7953 | |
|
| 0.3766 | 15.0 | 345 | 0.4973 | 0.7992 | |
|
| 0.3213 | 16.0 | 368 | 0.5221 | 0.7874 | |
|
| 0.329 | 17.0 | 391 | 0.5400 | 0.7835 | |
|
| 0.3427 | 18.0 | 414 | 0.5252 | 0.7913 | |
|
| 0.3472 | 19.0 | 437 | 0.6208 | 0.7441 | |
|
| 0.3424 | 20.0 | 460 | 0.5320 | 0.7795 | |
|
| 0.3016 | 21.0 | 483 | 0.5488 | 0.7795 | |
|
| 0.3033 | 22.0 | 506 | 0.5889 | 0.7480 | |
|
| 0.3083 | 23.0 | 529 | 0.6108 | 0.7638 | |
|
| 0.2772 | 24.0 | 552 | 0.5845 | 0.7480 | |
|
| 0.287 | 25.0 | 575 | 0.5242 | 0.8071 | |
|
| 0.2651 | 26.0 | 598 | 0.6276 | 0.7598 | |
|
| 0.2696 | 27.0 | 621 | 0.5649 | 0.7835 | |
|
| 0.2701 | 28.0 | 644 | 0.6103 | 0.7756 | |
|
| 0.2451 | 29.0 | 667 | 0.6207 | 0.7638 | |
|
| 0.2705 | 30.0 | 690 | 0.5990 | 0.7756 | |
|
| 0.2553 | 31.0 | 713 | 0.5962 | 0.7835 | |
|
| 0.2559 | 32.0 | 736 | 0.6681 | 0.7717 | |
|
| 0.2405 | 33.0 | 759 | 0.5917 | 0.7638 | |
|
| 0.2707 | 34.0 | 782 | 0.5906 | 0.7638 | |
|
| 0.3004 | 35.0 | 805 | 0.5905 | 0.7874 | |
|
| 0.2404 | 36.0 | 828 | 0.5914 | 0.7677 | |
|
| 0.242 | 37.0 | 851 | 0.7637 | 0.7638 | |
|
| 0.2221 | 38.0 | 874 | 0.7117 | 0.7598 | |
|
| 0.2196 | 39.0 | 897 | 0.6442 | 0.7835 | |
|
| 0.23 | 40.0 | 920 | 0.7011 | 0.7717 | |
|
| 0.2045 | 41.0 | 943 | 0.7822 | 0.7598 | |
|
| 0.2043 | 42.0 | 966 | 0.7339 | 0.7520 | |
|
| 0.2413 | 43.0 | 989 | 0.6917 | 0.7677 | |
|
| 0.2135 | 44.0 | 1012 | 0.6954 | 0.7717 | |
|
| 0.2194 | 45.0 | 1035 | 0.6729 | 0.7795 | |
|
| 0.211 | 46.0 | 1058 | 0.6841 | 0.7835 | |
|
| 0.2155 | 47.0 | 1081 | 0.7108 | 0.7677 | |
|
| 0.2231 | 48.0 | 1104 | 0.6758 | 0.7677 | |
|
| 0.2364 | 49.0 | 1127 | 0.7747 | 0.7520 | |
|
| 0.222 | 50.0 | 1150 | 0.7104 | 0.7638 | |
|
| 0.2018 | 51.0 | 1173 | 0.6885 | 0.7953 | |
|
| 0.219 | 52.0 | 1196 | 0.7609 | 0.7520 | |
|
| 0.1916 | 53.0 | 1219 | 0.8394 | 0.7677 | |
|
| 0.1767 | 54.0 | 1242 | 0.7910 | 0.7717 | |
|
| 0.236 | 55.0 | 1265 | 0.7601 | 0.7756 | |
|
| 0.1898 | 56.0 | 1288 | 0.7501 | 0.7717 | |
|
| 0.1876 | 57.0 | 1311 | 0.7492 | 0.7756 | |
|
| 0.1592 | 58.0 | 1334 | 0.7905 | 0.7638 | |
|
| 0.1772 | 59.0 | 1357 | 0.7411 | 0.7717 | |
|
| 0.1787 | 60.0 | 1380 | 0.8145 | 0.7795 | |
|
| 0.1782 | 61.0 | 1403 | 0.7721 | 0.7795 | |
|
| 0.1781 | 62.0 | 1426 | 0.8022 | 0.7835 | |
|
| 0.1884 | 63.0 | 1449 | 0.8630 | 0.7756 | |
|
| 0.1905 | 64.0 | 1472 | 0.7472 | 0.7953 | |
|
| 0.16 | 65.0 | 1495 | 0.7761 | 0.7874 | |
|
| 0.1619 | 66.0 | 1518 | 0.8586 | 0.7795 | |
|
| 0.1768 | 67.0 | 1541 | 0.7700 | 0.7835 | |
|
| 0.1395 | 68.0 | 1564 | 0.8326 | 0.7717 | |
|
| 0.1536 | 69.0 | 1587 | 0.8442 | 0.7756 | |
|
| 0.208 | 70.0 | 1610 | 0.9289 | 0.7677 | |
|
| 0.1783 | 71.0 | 1633 | 0.9022 | 0.7638 | |
|
| 0.1572 | 72.0 | 1656 | 0.8510 | 0.7677 | |
|
| 0.1349 | 73.0 | 1679 | 0.7962 | 0.7677 | |
|
| 0.148 | 74.0 | 1702 | 0.8641 | 0.7756 | |
|
| 0.1768 | 75.0 | 1725 | 0.9277 | 0.7677 | |
|
| 0.1833 | 76.0 | 1748 | 0.8663 | 0.7638 | |
|
| 0.1696 | 77.0 | 1771 | 0.8302 | 0.7756 | |
|
| 0.1577 | 78.0 | 1794 | 0.8576 | 0.7638 | |
|
| 0.1724 | 79.0 | 1817 | 0.8652 | 0.7598 | |
|
| 0.1525 | 80.0 | 1840 | 0.8567 | 0.7717 | |
|
| 0.158 | 81.0 | 1863 | 0.9139 | 0.7598 | |
|
| 0.1639 | 82.0 | 1886 | 0.9689 | 0.7520 | |
|
| 0.1424 | 83.0 | 1909 | 0.9698 | 0.7638 | |
|
| 0.1224 | 84.0 | 1932 | 1.0239 | 0.7717 | |
|
| 0.1765 | 85.0 | 1955 | 0.9072 | 0.7795 | |
|
| 0.1726 | 86.0 | 1978 | 0.9436 | 0.7520 | |
|
| 0.1584 | 87.0 | 2001 | 0.8775 | 0.7638 | |
|
| 0.164 | 88.0 | 2024 | 0.8592 | 0.7717 | |
|
| 0.1682 | 89.0 | 2047 | 0.9051 | 0.7638 | |
|
| 0.1455 | 90.0 | 2070 | 1.0020 | 0.7717 | |
|
| 0.1596 | 91.0 | 2093 | 0.9423 | 0.7677 | |
|
| 0.1667 | 92.0 | 2116 | 0.9586 | 0.7638 | |
|
| 0.132 | 93.0 | 2139 | 0.9890 | 0.7638 | |
|
| 0.1335 | 94.0 | 2162 | 0.9922 | 0.7717 | |
|
| 0.1538 | 95.0 | 2185 | 0.9534 | 0.7520 | |
|
| 0.1288 | 96.0 | 2208 | 1.0714 | 0.7480 | |
|
| 0.1661 | 97.0 | 2231 | 0.9950 | 0.7598 | |
|
| 0.1392 | 98.0 | 2254 | 0.9866 | 0.7520 | |
|
| 0.1413 | 99.0 | 2277 | 1.0638 | 0.7598 | |
|
| 0.1619 | 100.0 | 2300 | 1.0178 | 0.7598 | |
|
| 0.1537 | 101.0 | 2323 | 0.9892 | 0.7638 | |
|
| 0.137 | 102.0 | 2346 | 0.9524 | 0.7559 | |
|
| 0.1416 | 103.0 | 2369 | 1.0539 | 0.7402 | |
|
| 0.1477 | 104.0 | 2392 | 1.0825 | 0.7283 | |
|
| 0.1283 | 105.0 | 2415 | 1.0008 | 0.7520 | |
|
| 0.1498 | 106.0 | 2438 | 0.9702 | 0.7638 | |
|
| 0.1576 | 107.0 | 2461 | 1.0144 | 0.7677 | |
|
| 0.1433 | 108.0 | 2484 | 0.9457 | 0.7638 | |
|
| 0.1377 | 109.0 | 2507 | 0.9770 | 0.7677 | |
|
| 0.1163 | 110.0 | 2530 | 1.1386 | 0.7559 | |
|
| 0.1449 | 111.0 | 2553 | 1.0589 | 0.7559 | |
|
| 0.1475 | 112.0 | 2576 | 1.0110 | 0.7480 | |
|
| 0.1582 | 113.0 | 2599 | 0.9657 | 0.7677 | |
|
| 0.1291 | 114.0 | 2622 | 0.9563 | 0.7756 | |
|
| 0.1106 | 115.0 | 2645 | 1.1004 | 0.7480 | |
|
| 0.1339 | 116.0 | 2668 | 1.0327 | 0.7520 | |
|
| 0.1344 | 117.0 | 2691 | 1.0161 | 0.7520 | |
|
| 0.1433 | 118.0 | 2714 | 1.0312 | 0.7559 | |
|
| 0.1271 | 119.0 | 2737 | 1.0266 | 0.7598 | |
|
| 0.1222 | 120.0 | 2760 | 1.0119 | 0.7638 | |
|
| 0.1235 | 121.0 | 2783 | 1.0808 | 0.7520 | |
|
| 0.1311 | 122.0 | 2806 | 1.0612 | 0.7520 | |
|
| 0.1219 | 123.0 | 2829 | 1.1412 | 0.7520 | |
|
| 0.148 | 124.0 | 2852 | 1.0836 | 0.7402 | |
|
| 0.1076 | 125.0 | 2875 | 1.0629 | 0.7559 | |
|
| 0.1306 | 126.0 | 2898 | 1.0791 | 0.7362 | |
|
| 0.1153 | 127.0 | 2921 | 1.1495 | 0.7402 | |
|
| 0.1239 | 128.0 | 2944 | 1.1446 | 0.7520 | |
|
| 0.1533 | 129.0 | 2967 | 1.0818 | 0.7441 | |
|
| 0.136 | 130.0 | 2990 | 1.0558 | 0.7520 | |
|
| 0.1189 | 131.0 | 3013 | 1.0423 | 0.7520 | |
|
| 0.1247 | 132.0 | 3036 | 1.0581 | 0.7638 | |
|
| 0.1136 | 133.0 | 3059 | 1.0132 | 0.7717 | |
|
| 0.1492 | 134.0 | 3082 | 1.1127 | 0.7441 | |
|
| 0.1184 | 135.0 | 3105 | 1.1450 | 0.7402 | |
|
| 0.1122 | 136.0 | 3128 | 1.1063 | 0.7520 | |
|
| 0.1047 | 137.0 | 3151 | 1.1029 | 0.7441 | |
|
| 0.1285 | 138.0 | 3174 | 1.1563 | 0.7402 | |
|
| 0.1004 | 139.0 | 3197 | 1.1552 | 0.7362 | |
|
| 0.1285 | 140.0 | 3220 | 1.1097 | 0.7480 | |
|
| 0.1257 | 141.0 | 3243 | 1.1602 | 0.7402 | |
|
| 0.1075 | 142.0 | 3266 | 1.1912 | 0.7559 | |
|
| 0.1098 | 143.0 | 3289 | 1.1894 | 0.7520 | |
|
| 0.1148 | 144.0 | 3312 | 1.1551 | 0.7441 | |
|
| 0.1489 | 145.0 | 3335 | 1.1379 | 0.7441 | |
|
| 0.1461 | 146.0 | 3358 | 1.1726 | 0.7480 | |
|
| 0.1171 | 147.0 | 3381 | 1.1191 | 0.7441 | |
|
| 0.1262 | 148.0 | 3404 | 1.1662 | 0.7441 | |
|
| 0.1137 | 149.0 | 3427 | 1.1283 | 0.7480 | |
|
| 0.1118 | 150.0 | 3450 | 1.1388 | 0.7480 | |
|
| 0.1169 | 151.0 | 3473 | 1.1627 | 0.7520 | |
|
| 0.1021 | 152.0 | 3496 | 1.1821 | 0.7323 | |
|
| 0.1392 | 153.0 | 3519 | 1.1672 | 0.7323 | |
|
| 0.1111 | 154.0 | 3542 | 1.2136 | 0.7402 | |
|
| 0.1298 | 155.0 | 3565 | 1.1966 | 0.7402 | |
|
| 0.1114 | 156.0 | 3588 | 1.1382 | 0.7362 | |
|
| 0.09 | 157.0 | 3611 | 1.1460 | 0.7323 | |
|
| 0.1294 | 158.0 | 3634 | 1.1612 | 0.7441 | |
|
| 0.1186 | 159.0 | 3657 | 1.2204 | 0.7402 | |
|
| 0.1096 | 160.0 | 3680 | 1.2096 | 0.7441 | |
|
| 0.1107 | 161.0 | 3703 | 1.1822 | 0.7480 | |
|
| 0.1094 | 162.0 | 3726 | 1.1908 | 0.7480 | |
|
| 0.1112 | 163.0 | 3749 | 1.1647 | 0.7402 | |
|
| 0.1042 | 164.0 | 3772 | 1.2523 | 0.7441 | |
|
| 0.0993 | 165.0 | 3795 | 1.2040 | 0.7402 | |
|
| 0.105 | 166.0 | 3818 | 1.2296 | 0.7402 | |
|
| 0.1071 | 167.0 | 3841 | 1.2863 | 0.7480 | |
|
| 0.108 | 168.0 | 3864 | 1.2372 | 0.7441 | |
|
| 0.1076 | 169.0 | 3887 | 1.1872 | 0.7480 | |
|
| 0.1107 | 170.0 | 3910 | 1.2354 | 0.7323 | |
|
| 0.1012 | 171.0 | 3933 | 1.2105 | 0.7441 | |
|
| 0.0918 | 172.0 | 3956 | 1.2026 | 0.7441 | |
|
| 0.1043 | 173.0 | 3979 | 1.2925 | 0.7559 | |
|
| 0.1035 | 174.0 | 4002 | 1.2314 | 0.7402 | |
|
| 0.1101 | 175.0 | 4025 | 1.1943 | 0.7441 | |
|
| 0.1084 | 176.0 | 4048 | 1.2069 | 0.7362 | |
|
| 0.1247 | 177.0 | 4071 | 1.2303 | 0.7520 | |
|
| 0.1278 | 178.0 | 4094 | 1.2118 | 0.7480 | |
|
| 0.1117 | 179.0 | 4117 | 1.2213 | 0.7480 | |
|
| 0.1123 | 180.0 | 4140 | 1.2403 | 0.7480 | |
|
| 0.0918 | 181.0 | 4163 | 1.1987 | 0.7441 | |
|
| 0.0827 | 182.0 | 4186 | 1.2358 | 0.7441 | |
|
| 0.0814 | 183.0 | 4209 | 1.2608 | 0.7441 | |
|
| 0.0897 | 184.0 | 4232 | 1.2370 | 0.7441 | |
|
| 0.1321 | 185.0 | 4255 | 1.2317 | 0.7480 | |
|
| 0.1194 | 186.0 | 4278 | 1.2289 | 0.7441 | |
|
| 0.1154 | 187.0 | 4301 | 1.1964 | 0.7441 | |
|
| 0.0964 | 188.0 | 4324 | 1.2009 | 0.7441 | |
|
| 0.0903 | 189.0 | 4347 | 1.2123 | 0.7441 | |
|
| 0.1174 | 190.0 | 4370 | 1.2335 | 0.7441 | |
|
| 0.0846 | 191.0 | 4393 | 1.2399 | 0.7441 | |
|
| 0.1073 | 192.0 | 4416 | 1.2432 | 0.7441 | |
|
| 0.0892 | 193.0 | 4439 | 1.2604 | 0.7480 | |
|
| 0.1158 | 194.0 | 4462 | 1.2473 | 0.7480 | |
|
| 0.1153 | 195.0 | 4485 | 1.2267 | 0.7441 | |
|
| 0.1208 | 196.0 | 4508 | 1.2178 | 0.7441 | |
|
| 0.083 | 197.0 | 4531 | 1.2145 | 0.7480 | |
|
| 0.1331 | 198.0 | 4554 | 1.2215 | 0.7441 | |
|
| 0.0943 | 199.0 | 4577 | 1.2238 | 0.7441 | |
|
| 0.0926 | 200.0 | 4600 | 1.2236 | 0.7441 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.46.0.dev0 |
|
- Pytorch 2.4.1+cu121 |
|
- Datasets 3.0.1 |
|
- Tokenizers 0.20.1 |
|
|
