Removes another owner reference.