Persist exceptions when retry count is exceeded