Handle send to port failures better