What is ddboolq in the evaluation? We cannot find the "ddboolq" task in lm-evaluation-harness.

#5
by CobraMamba - opened

We cannot find the "ddboolq" in lm-evaluation-harness.

We can only find the boolq task in the task list. And we run the boolq for the open-llama-3b, the result is different.

image.png

So want to know what is ddboolq in the evaluation?

Sign up or log in to comment