Fix a bug that cause remove_face to alter a list without accounting for the change of indices.