Add a map of partial objects with their references in the decoded graph.