Prevent calling zmq.Poller.poll with negative timeout