Revert "vfp: since we use hardfloat, change the modifer accordingly"

This reverts commit c4e7f3d460714323eb232765012f859bd79f358f.