Make Scalar a template parameter of the operators instead.