Preserve relation models when setting without data

Existing models for associations would be removed accidentally if a
`set` was performed without new data.