Determine the color of each sprite