Before revision:  With our proposed initialization, regularizers and architectural changes combined, we are able to obtain 65.03\% verified error on CIFAR-10 (\epsilon=\frac{8}{255}) and 82.13 \% verified error on TinyImageNet (\epsilon=\frac{1}{255}) using very short training schedules (160 and 80 total epochs, respectively), outperforming literature SOTA trained with a few hundreds or thousands epochs  .
After revision:  With our proposed initialization, regularizers and architectural changes combined, we are able to obtain 65.03\% verified error on CIFAR-10 (\epsilon=\frac{8}{255}) and 82.13 \% verified error on TinyImageNet (\epsilon=\frac{1}{255}) using very short training schedules (160 and 80 total epochs, respectively), outperforming literature SOTA trained with hundreds or thousands epochs .