Not necessarily. Familiarity with your field can be helpful in understanding your product’s goals and limitations, but it is not essential to perform an evaluation of usability issues specifically.  Bringing in an evaluator with a broader background is actually more ideal  because they have a wider understanding of how a design can perform well or poorly in different contexts.