vfp: since we use hardfloat, change the modifer accordingly

idea is taken here -
https://github.com/poondog/kangaroo-m7-mkIII/commit/d1f00d07db9a8d9c55a820887df6087c3f6e5b0c