If you've had trouble in the past discussing personal health issues with a doctor, now is the time for a fresh start. A primary care doctor is trained to serve as a resource for any of your questions or health concerns, including those of a sexual or psychological nature. If you're having a hard time communicating with your doctor, schedule an appointment and bring it up. It's wise to give your present doctor the chance to respond to your concerns before switching doctors. After all, he or she already knows you, and breaking an existing healthcare partnership is not always necessarily in your best interest.
Doctors lose and gain patients all the time.
It's part of being a medical professional, and they usually don't take it personally. Their main concern is your continued health and well-being, and if you will be best served by another doctor, they will usually step aside gracefully and wish you well. That means you're responsible for your health as much as, or more than, your physician is. He or she doesn't have to be your sole source of information. Educate yourself on special concerns - the library and bookstore are excellent sources of additional information.