Do some kind of hierarchical culling