We can have all FieldInfo/FieldAccessor loaded when loading the graph. We then delete them when the graph instance is deleted.