Worry is warranted if bumps on your face are painful, undergo rapid changes in size or colour, bleed, or persist despite using common remedies like salicylic acid, indicating a need for a professional evaluation.