Fix has and belogns to many, so it calls remove_relationship on the right object.