Remove unused cached inverted CTM