Add new compiler flags for arm and neon and remove unneeded cpp flags