Fix deleting data when person loses affiliation.

When a person disappears from a view it really just means they no
longer have that affiliation. But because they had no data it was
removing the embedded model data.