Remove culled rooms from the room graph.