Revert "Build vfp with Neon Optimizations"

This reverts commit 55c029555d456353c92883d6f59a51a3a18dab4a.