Revert " makefile: neon: Enable unsafe-math-optimizations"

This reverts commit aa63b515e8beb708d23762991be3495107c0cb93.