Mention it to your spiritual director for some accountability, but otherwise, don t think about it. Just let it go. You must report these feelings to your director as soon as they come up, and keep him updated as to what is happening. You ve got to have accountability. Otherwise you are an easy mark for rationalization.
Objectivity is what is needed here.
Often when a man has never dated or has been unsuccessful with women before entering the priesthood, he is entranced with the idea that an attractive woman is romantically inclined toward him. In other words he is more vulnerable. He must know that his worth comes from God and his noble, noble calling to the priesthood. All the women in the world couldn t match that. And furthermore, it may be that she is attracted to him because he is a priest.