evaluation/infinite_bench_eval/README.md

This is our script to evaluate InfiniteBench.

You need to first install dependencies from requirement.txt

pip install -r requirement.txt

Then you need to configure the model_path and data_home in test_vllm.sh and then run the following command

bash test_vllm.sh | grep "final display" 

to get the corresponding score