[BUGFIX] One to none relationship unable to set a value to an old one

this fixes #2331
Though I'm a little nervous to see that removing this check makes all tests pass