There may not be a completely automatic connection, but it should not be underestimated. A number of causes, especially those of a non-pathological nature, are common to both sex drive problems and sexual potency problems.