Remove unneeded compiler flags

The mfloat-abi and mfpu are already set by build combo.