deselect fds when main port is closed