I gave up trying to compute the colors, so now there is a fance table that looks them up.
Greys and default colors are still raw, so no lookup or computation is done.