Combine the colors when looking up or down, otherwise turning looks weird