Script for eval
#9
by
ewqr2130
- opened
Hello mlabonne
I am huge fan and a big followers of all of your works! Thanks for these fantastic blogs and models!
Quick question, do you have script for offline evaluation? How did you evaluate your model on these different bench marks that you posted??
Thanks!
Hi @ewqr2130 thanks! It's a good question, I should provide a link in the readme file.
I use a small tool I built called LLM AutoEval (https://github.com/mlabonne/llm-autoeval), it's super easy to use.