Clean up adjacency table when edges are deleted