File size: 441 Bytes
5f2eb5c
 
 
 
 
1
2
3
4
5
6
model,score,throughput,response_length,latency,energy
lmsys/vicuna-7B,1000,30.08236985276053,283.0862995298858,9.431178230227955,2271.4826004029537
lmsys/vicuna-13B,1000,17.509990378755237,281.76623376623377,16.124334009682688,4283.697810470779
tatsu-lab/alpaca-7B,1000,30.09713731797294,125.20013431833445,4.129986896187982,916.045386501007
metaai/llama-7B,1000,25.768609507174105,64.59032907991941,2.284814629996714,525.7081235728675