Lip balms that contain phenol, menthol, or salicylic acid make your lips drier. As a result, you apply more, and the cycle continues. When you use some of these products, you may also get a tingling sensation. This either irritates the skin or, like an exfoliator, removes the outer layers of the lip skin.