Let the words roll off. Don't engage in confrontation. The anti-gun crowd has no clue that an armed society is indeed a polite society. Any person or even a police officer that carries a gun will tell you how they avoid problems and go out of their way to avoid confrontation. You don't want to get into a situation where you have a gun over a driving offense.
Tempers can flare, but is rare that gun permit owners are involved in such situations.
They avoid far more than they ever escalate. Most are trained and know the perils of such actions. If you have a gun for self-defense, make certain it doesn't enter into family disputes business disputes or other situations close to you. In heated emotional disputes you are so involved you can loose track of your common sense and the laws and rules you are embraced by. You can make major errors that will cost you not only financial problems, but legal problems as well.