Store all hilights as we might need to repaint everything