File size: 3,393 Bytes
5096607 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 |
buraksoner@buraksoner-XPS-15-7590:~/sai-tr/workspace_maxim_ai85_cifar100$ python tools/generate_leaderboard.py Found checkpoints (except reproduce checkpoints) at these locations: /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/maxim000_nas_8b /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/maxim001_simplenet_2b4b8b /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow001_nas_8b_SAM /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow002_nas_2b8b_noSAM_4lyrDeep /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow003_nas_2b8b_noSAM_3lyrDeep /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow004_nas_2b8b_noSAM_2lyrDeep /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow005_nas_2b8b_noSAM_1lyrDeep /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow006_nas_AP2b8b_earlyexit /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow007_nas_AP2b8b_tuned /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow008_naslarge_2b8b_noSAM /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow009_nas_aha_AP8b_7bBias /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow010_naslarge_2b8b_wSAM /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow011_naslarge_AP8b_wSAM_failed /home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow012_naslarge_AP2b8b_wSAM Gathering hardware-mode top-1 accuracy and size info from each checkpoint Leaderboard -------------------------------- Name : maxim000_nas_8b Top-1 accuracy: 64.22 Size (KBytes) : 348.772 Name : maxim001_simplenet_2b4b8b Top-1 accuracy: 55.76 Size (KBytes) : 166.448 Name : shallow001_nas_8b_SAM Top-1 accuracy: 64.31 Size (KBytes) : 348.772 Name : shallow002_nas_2b8b_noSAM_4lyrDeep Top-1 accuracy: 61.73 Size (KBytes) : 279.652 Name : shallow003_nas_2b8b_noSAM_3lyrDeep Top-1 accuracy: 59.95 Size (KBytes) : 210.532 Name : shallow004_nas_2b8b_noSAM_2lyrDeep Top-1 accuracy: 57.98 Size (KBytes) : 141.412 Name : shallow005_nas_2b8b_noSAM_1lyrDeep Top-1 accuracy: 57.34 Size (KBytes) : 127.588 Name : shallow006_nas_AP2b8b_earlyexit Top-1 accuracy: 46.51 Size (KBytes) : 127.588 , but has "-1/+1 only" 2b layers, so this would be: 104.548 KBytes on MAX78002 Name : shallow007_nas_AP2b8b_tuned Top-1 accuracy: 54.71 Size (KBytes) : 127.588 , but has "-1/+1 only" 2b layers, so this would be: 104.548 KBytes on MAX78002 Name : shallow008_naslarge_2b8b_noSAM Top-1 accuracy: 65.88 Size (KBytes) : 328.548 Name : shallow009_nas_aha_AP8b_7bBias Top-1 accuracy: 55.06 Size (KBytes) : 127.588 , but has "-1/+1 only" 2b layers, so this would be: 90.724 KBytes on MAX78002 Name : shallow010_naslarge_2b8b_wSAM Top-1 accuracy: 66.38 Size (KBytes) : 328.548 Name : shallow011_naslarge_AP8b_wSAM_failed Top-1 accuracy: 36.09 Size (KBytes) : 328.548 , but has "-1/+1 only" 2b layers, so this would be: 192.356 KBytes on MAX78002 Name : shallow012_naslarge_AP2b8b_wSAM Top-1 accuracy: 61.34 Size (KBytes) : 328.548 , but has "-1/+1 only" 2b layers, so this would be: 241.508 KBytes on MAX78002 |