removing fd's from the sharded epoll is too expensive