Shrink IndexTreeNodes when the outer indices are removed.