Remove some type annotations (relevant for parametric colors)

There are probably more places where one could type-generalize,
but I don't know enough about the underlying algorithms to be sure.