If we assign nil to the association, we should not fail