Always remove the inverse record (if exists) from a belongsTo relationship
fixes #2331