do not dispatch to re/im when all factors are already known

Refactor so re and im will not have to re-calculate all that has
already been separated.