Avoid a bunch of HSV -> RGB's conversions that really only need to happen once.