fix FASTOCTREE quantizer for large images (>16MP)

the color value counter sums all color values and this overflows
a uint32 at 16M white pixels, 32M gray pixels, etc.