Fix a bug in SocketManager with epoll linux usage