Remove color_table where it's no longer needed