When in doubt, always use sir/ma'm for anyone. Father, to me, generally denotes a membership in the Catholic community. However, as a Protestant, I have called a Catholic priest by father, to which he replied favorably. Either one should be okay, sir if father makes you uncomfortable.