Always bail out when the compositor is closed.

errno can both be EPIPE and ECONNRESET when reading from the connection
after the server is closed.