Low libido can be caused due to various reasons. Some of the physical issues that could cause low libido are low testosterone, too little or too much exercise, prescription medicines, alcohol, and drug use. Excess stress, your relationships, and other psychological factors could also cause low libido.