Fix the bug not deleting fd after the child died.

When use select as event loop, we cannot use a closed fd to select, otherwise the select will throw a exception.
And it will cause the whole event loop to exit.