Are the green vs red points shown the points that fit the RANSAC selected model vs those that don't?  Since we have the exact transformation, we have two sets of inliers/outlines: those from the matching algorithm and those from RANSAC.