Close right away when connection is closed by remote