Look in binders when building size change graph

Fixes #1781