Track unhandled objects

Required as we move from sinks to filters,
which means pipelines could trivially do the wrong thing(c).

Closes #47.