Fix bug in stability polynomial computation when mode='float'.

Speed up some operations by using mode='float'.