File size: 256 Bytes
f3bdb91
 
 
 
 
 
1
2
3
4
5
6
7
model,score,throughput,verbosity,latency,energy,memory
vicuna-13B,1054,19.47,178.71,10.37,12,26232
vicuna-7B,1007,31.26,217.33,7.71,32,14087
llama-13B,854,18.49,390.9,22.74,24,26233
t5-3B,941,31.98,131.12,6.09,4,8031
rwkv-7B,928,23.09,239.98,9.62,12,15790