No, this is not a conflict of interest. She will base her judgment on the facts of the case. If your lawyer is concerned, he or she can request reassignment.  Habitual offenses are items that can be taken into consideration for truly things like impeaching your testimony and of course, enhancing your sentencing.  You really need to talk to your criminal defense attorney about all of these issues and whether you should motion for recusal by the judge.