Keep track of number of correspondences relative to valid reprojected pixels
Retain transformation that yeilded greatest number of correspondences
Metrics to help detect potential drift issue.
Drift metrics relative to valid incoming depth pixels rather than valid reprojections