Don't block when shutting down client/server