Table 15: ResNet-50 learnt budgets using Chase at  $80\%$  and channel-wise sparsity at  $40\%$ .
ResNet-50	Fully Dense Params	Fully Dense Weights Dimension	Weights Dimension after Chase	Parameter-wise Sparsity (%)	Channel-wise Sparsity (%)
Backbone	23454912	-	-	80	40
Layer 1 - conv1	9408	64 × 3 × 7 × 7	64 × 3 × 7 × 7	5.11	0.00
Layer 2 - layer1.0Conv1	4096	64 × 64 × 1 × 1	64 × 64 × 1 × 1	8.45	0.00
Layer 3 - layer1.0Conv2	36864	64 × 64 × 3 × 3	64 × 64 × 3 × 3	44.61	0.00
Layer 4 - layer1.0Conv3	16384	256 × 64 × 1 × 1	256 × 64 × 1 × 1	51.16	0.00
Layer 5 - layer1.0.downsample.0	16384	256 × 64 × 1 × 1	256 × 64 × 1 × 1	65.58	0.00
Layer 6 - layer1.1Conv1	16384	64 × 256 × 1 × 1	63 × 256 × 1 × 1	53.13	1.56
Layer 7 - layer1.1Conv2	36864	64 × 64 × 3 × 3	62 × 63 × 3 × 3	42.51	3.13
Layer 8 - layer1.1Conv3	16384	256 × 64 × 1 × 1	256 × 62 × 1 × 1	36.48	0.00
Layer 9 - layer1.2Conv1	16384	64 × 256 × 1 × 1	63 × 256 × 1 × 1	48.64	1.56
Layer 10 - layer1.2Conv2	36864	64 × 64 × 3 × 3	64 × 63 × 3 × 3	52.23	0.00
Layer 11 - layer1.2Conv3	16384	256 × 64 × 1 × 1	256 × 64 × 1 × 1	48.68	0.00
Layer 12 - layer2.0Conv1	32768	128 × 256 × 1 × 1	128 × 256 × 1 × 1	32.51	0.00
Layer 13 - layer2.0Conv2	147456	128 × 128 × 3 × 3	127 × 128 × 3 × 3	71.73	0.78
Layer 14 - layer2.0Conv3	65536	512 × 128 × 1 × 1	512 × 127 × 1 × 1	54.16	0.00
Layer 15 - layer2.0.downsample.0	32768	512 × 256 × 1 × 1	512 × 256 × 1 × 1	86.72	0.00
Layer 16 - layer2.1Conv1	65536	128 × 512 × 1 × 1	111 × 512 × 1 × 1	79.24	13.28
Layer 17 - layer2.1Conv2	147456	128 × 128 × 3 × 3	117 × 111 × 3 × 3	73.93	8.59
Layer 18 - layer2.1Conv3	65536	512 × 128 × 1 × 1	512 × 117 × 1 × 1	69.68	0.00
Layer 19 - layer2.2Conv1	65536	128 × 512 × 1 × 1	106 × 512 × 1 × 1	79.15	17.19
Layer 20 - layer2.2Conv2	147456	128 × 128 × 3 × 3	108 × 106 × 3 × 3	74.98	15.62
Layer 21 - layer2.2Conv3	65536	512 × 128 × 1 × 1	512 × 108 × 1 × 1	74.50	0.00
Layer 22 - layer2.3Conv1	65536	128 × 512 × 1 × 1	122 × 512 × 1 × 1	78.87	4.69
Layer 23 - layer2.3Conv2	147456	128 × 128 × 3 × 3	96 × 122 × 3 × 3	78.88	25.00
Layer 24 - layer2.3Conv3	65536	512 × 128 × 1 × 1	512 × 96 × 1 × 1	71.11	0.00
Layer 25 - layer3.0Conv1	131072	256 × 512 × 1 × 1	255 × 512 × 1 × 1	57.36	0.39
Layer 26 - layer3.0Conv2	589824	256 × 256 × 3 × 3	241 × 255 × 3 × 3	85.19	5.86
Layer 27 - layer3.0Conv3	262144	1024 × 256 × 1 × 1	1024 × 241 × 1 × 1	65.11	0.00
Layer 28 - layer3.0.downsample.0	524288	1024 × 512 × 1 × 1	1024 × 512 × 1 × 1	97.36	0.00
Layer 29 - layer3.1Conv1	262144	256 × 1024 × 1 × 1	151 × 1024 × 1 × 1	85.45	41.80
Layer 30 - layer3.1Conv2	589824	256 × 256 × 3 × 3	143 × 151 × 3 × 3	75.48	44.14
Layer 31 - layer3.1Conv3	262144	1024 × 256 × 1 × 1	1024 × 143 × 1 × 1	76.19	0.00
Layer 32 - layer3.2Conv1	262144	256 × 1024 × 1 × 1	151 × 1024 × 1 × 1	83.22	41.80
Layer 33 - layer3.2Conv2	589824	256 × 256 × 3 × 3	108 × 151 × 3 × 3	77.29	57.81
Layer 34 - layer3.2Conv3	262144	1024 × 256 × 1 × 1	1024 × 108 × 1 × 1	76.97	0.00
Layer 35 - layer3.3Conv1	262144	256 × 1024 × 1 × 1	91 × 1024 × 1 × 1	84.94	64.84
Layer 36 - layer3.3Conv2	589824	256 × 256 × 3 × 3	74 × 91 × 3 × 3	63.20	71.88
Layer 37 - layer3.3Conv3	262144	1024 × 256 × 1 × 1	1024 × 74 × 1 × 1	78.42	0.00
Layer 38 - layer3.4Conv1	262144	256 × 1024 × 1 × 1	76 × 1024 × 1 × 1	84.05	70.31
Layer 39 - layer3.4Conv2	589824	256 × 256 × 3 × 3	41 × 76 × 3 × 3	56.02	83.98
Layer 40 - layer3.4Conv3	262144	1024 × 256 × 1 × 1	1024 × 41 × 1 × 1	73.70	0.00
Layer 41 - layer3.5Conv1	262144	256 × 1024 × 1 × 1	105 × 1024 × 1 × 1	83.33	58.59
Layer 42 - layer3.5Conv2	589824	256 × 256 × 3 × 3	44 × 105 × 3 × 3	63.34	82.81
Layer 43 - layer3.5Conv3	262144	1024 × 256 × 1 × 1	1024 × 44 × 1 × 1	66.12	0.00
Layer 44 - layer4.0Conv1	524288	512 × 1024 × 1 × 1	499 × 1024 × 1 × 1	74.52	2.54
Layer 45 - layer4.0Conv2	2359296	512 × 512 × 3 × 3	241 × 499 × 3 × 3	88.06	52.93
Layer 46 - layer4.0Conv3	1048576	2048 × 512 × 1 × 1	2048 × 241 × 1 × 1	65.89	0.00
Layer 47 - layer4.0.downsample.0	2097152	2048 × 1024 × 1 × 1	2048 × 1024 × 1 × 1	99.55	0.00
Layer 48 - layer4.1Conv1	1048576	512 × 2048 × 1 × 1	146 × 2048 × 1 × 1	84.56	71.09
Layer 49 - layer4.1Conv2	2359296	512 × 512 × 3 × 3	89 × 146 × 3 × 3	62.39	82.23
Layer 50 - layer4.1Conv3	1048576	2048 × 512 × 1 × 1	2048 × 89 × 1 × 1	72.09	0.00
Layer 51 - layer4.2Conv1	1048576	512 × 2048 × 1 × 1	489 × 2048 × 1 × 1	82.31	4.49
Layer 52 - layer4.2Conv2	2359296	512 × 512 × 3 × 3	292 × 489 × 3 × 3	87.01	42.97
Layer 53 - layer4.2Conv3	1048576	2048 × 512 × 1 × 1	2048 × 292 × 1 × 1	62.42	0.00
Layer 54 - fc	2048000	1000 × 2048	1000 × 2048	61.82	0.00