If accept error is unrecoverable, exit right away