buraksoner@buraksoner-XPS-15-7590:~/sai-tr/workspace_maxim_ai85_cifar100$ python tools/generate_leaderboard.py 

Found checkpoints (except reproduce checkpoints) at these locations:
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/maxim000_nas_8b
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/maxim001_simplenet_2b4b8b
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow001_nas_8b_SAM
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow002_nas_2b8b_noSAM_4lyrDeep
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow003_nas_2b8b_noSAM_3lyrDeep
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow004_nas_2b8b_noSAM_2lyrDeep
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow005_nas_2b8b_noSAM_1lyrDeep
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow006_nas_AP2b8b_earlyexit
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow007_nas_AP2b8b_tuned
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow008_naslarge_2b8b_noSAM
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow009_nas_aha_AP8b_7bBias
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow010_naslarge_2b8b_wSAM
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow011_naslarge_AP8b_wSAM_failed
/home/buraksoner/sai-tr/workspace_maxim_ai85_cifar100/checkpoints/shallow012_naslarge_AP2b8b_wSAM

Gathering hardware-mode top-1 accuracy and size info from each checkpoint

Leaderboard
--------------------------------
Name          :  maxim000_nas_8b
Top-1 accuracy:  64.22
Size (KBytes) :  348.772

Name          :  maxim001_simplenet_2b4b8b
Top-1 accuracy:  55.76
Size (KBytes) :  166.448

Name          :  shallow001_nas_8b_SAM
Top-1 accuracy:  64.31
Size (KBytes) :  348.772

Name          :  shallow002_nas_2b8b_noSAM_4lyrDeep
Top-1 accuracy:  61.73
Size (KBytes) :  279.652

Name          :  shallow003_nas_2b8b_noSAM_3lyrDeep
Top-1 accuracy:  59.95
Size (KBytes) :  210.532

Name          :  shallow004_nas_2b8b_noSAM_2lyrDeep
Top-1 accuracy:  57.98
Size (KBytes) :  141.412

Name          :  shallow005_nas_2b8b_noSAM_1lyrDeep
Top-1 accuracy:  57.34
Size (KBytes) :  127.588

Name          :  shallow006_nas_AP2b8b_earlyexit
Top-1 accuracy:  46.51
Size (KBytes) :  127.588 , but has "-1/+1 only" 2b layers, so this would be: 104.548 KBytes on MAX78002

Name          :  shallow007_nas_AP2b8b_tuned
Top-1 accuracy:  54.71
Size (KBytes) :  127.588 , but has "-1/+1 only" 2b layers, so this would be: 104.548 KBytes on MAX78002

Name          :  shallow008_naslarge_2b8b_noSAM
Top-1 accuracy:  65.88
Size (KBytes) :  328.548

Name          :  shallow009_nas_aha_AP8b_7bBias
Top-1 accuracy:  55.06
Size (KBytes) :  127.588 , but has "-1/+1 only" 2b layers, so this would be: 90.724 KBytes on MAX78002

Name          :  shallow010_naslarge_2b8b_wSAM
Top-1 accuracy:  66.38
Size (KBytes) :  328.548

Name          :  shallow011_naslarge_AP8b_wSAM_failed
Top-1 accuracy:  36.09
Size (KBytes) :  328.548 , but has "-1/+1 only" 2b layers, so this would be: 192.356 KBytes on MAX78002

Name          :  shallow012_naslarge_AP2b8b_wSAM
Top-1 accuracy:  61.34
Size (KBytes) :  328.548 , but has "-1/+1 only" 2b layers, so this would be: 241.508 KBytes on MAX78002