Fix corner case where with no UnaOps we could get stuck.