Properties: don't keep refs to graph objects

Fixes #2189