Actually raise exception if we're non-interactive