Don't split the g factor when not using endomorphism

An amazing 0.2% verification speedup (when not using the endomorphism).