Extract a BindingMap that treats SetBindings as first-class and sets them aside, to reduce the amount of scannign we have to do on plus(), since large graphs repeatedly instantiated (say, per request) can be eaten up by this overhead.