There are no specific supplements for symptoms of caffeine withdrawal, but you might find using OTC pain relievers like ibuprofen helpful for headache pain. If you want a more natural approach, simply drinking enough water can often get rid of a caffeine headache and may even help prevent one.