Revert "vfp/makefile: compile with neon optimization"

This reverts commit 10249d51ad3df9d4eb88aacb8ef0c6a7387bfd92.