Remove color dir, which lives in its own repo now