Don't attempt to ungroup non-family graph nodes.

Addresses #586