Get rid of color_table_cache member as well