Fix embarrassing bug: Put ALL input colors into the output colormap.

Vladimir Panteleev report.
Remove redundant comment.