we now store and calculate the hermitian conjugate of each operator instead of inferring it