Don't update inverse relation if it hasn't changed

Prevents flickering