Only log here if we do not have a -EAGAIN or -EWOULDBLOCK