Minor optimization to conflicting_pair_fixer to prevent generating downstream varants if no upstream variants.