Load our local mode
#8
by
pa3lo
- opened
Is it possible to run a local model (.gguf)?
I would like to evaluate aya23 and similar models
Hi. This leaderboard uses https://github.com/EleutherAI/lm-evaluation-harness
I am unaware of whether lm_eval_harness has supported the .gguf format.
Please double check the https://github.com/EleutherAI/lm-evaluation-harness.