Fix conversion to/from Ufixed* types

* Previously, conversions were attempting to force conversion to,
  e.g., HSV{Ufixed8}, which is not a valid type