Simplify color management
Give up on parallel processing

It was making the code nightmarish complicated, and it didn't make
things any faster on a four-cores machines---actually slower.