arm:lib: Correct Neon Flags

* I somehow derped the hard optimization by forgetting to remove the fp from the softfp.

Signed-off-by: Chet Kener <Cl3Kener@gmail.com>