Check network errors against SEC error set as well

Follow-up for #411