Revert "Enable -O3 optimization for arm"

This reverts commit f356533a95363470fcb147fafa4b5aca949291f6.