You should consult a physician for upper back pain if the pain is severe, persistent, not improved with initial self-care, or accompanied by symptoms like numbness, weakness, or tingling in your limbs.