Don't let min == max, resulting in everything being colored with the max color