More gracefully die when TCP server goes away on the other side.