Any tips to run the evaluation locally?

#14
by luffycodes - opened

hi, I was planning to run the evaluation locally, but the EleutherAI/lm-evaluation-harness github repo does not seem to support datasets like halueval, trap etc?
I was wondering if there is a way to run the eval locally?

luffycodes changed discussion status to closed

Sign up or log in to comment