My wife is so relaxed about going to the doctor. But presently I have a number of niggling problems, and I know I should go. Many men have memories of unpleasant feelings associated with hospitals and procedures, often from childhood. Put these in perspective. Its OK to discuss them at the doctor's office.
Many women get to know the family doctor in the context of child health problems.
It fosters a trusting relationship. Also, women are targeted for health screens more than men presently. And some men do feel stupid at the doctors. Well, think back to your childhood. Its likely it was your mother who answered for you.