I'd opt for some sort of back-off based retry with a final reinsertion into the queue if it has backed off fully and is still not succeeding.