No, on the contrary, Sulfonylureas can elevate Testosterone levels and thus increase libido and erectile function in men. On the other hand, Metformin is associated with a lowered sex drive and Erectile Dysfunction. Sulfonylureas don’t usually lead to impotence. However, the damage to blood vessels from diabetes can lead to impotence in men.