Renumber columns cache to remove hole