SFM: fix out of range index in remove_inconsistent_matches

index is -1 sometimes, so skip that index