remove cache of children when a parent is removed via $.remove