bundle_adjust: Robustness to lack of matches in individual pairs