Refusing to unify, far-right House members would not accept a more traditional speaker and moderate conservatives don’t want a hardliner.