Don't disable SSE4A when disabling AVX.

Thanks for Craig Topper for noticing it.