[math][ins] rewrite/move some math to ins_float_invariant

- use float_quat_vmult instead of FLOAT_QUAT_RMAT_B2N|N2B
- use float_quat_derivative instead of float_quat_vmul_left