model,score,throughput,verbosity,latency,energy,memory vicuna-13B,1054,19.47,178.71,10.37,12,26232 vicuna-7B,1007,31.26,217.33,7.71,32,14087 llama-13B,854,18.49,390.9,22.74,24,26233 t5-3B,941,31.98,131.12,6.09,4,8031 rwkv-7B,928,23.09,239.98,9.62,12,15790