model,throughput,response_length,latency,energy
BAIR/koala-13b,21.533160265051638,265.5540631296172,12.202378193294793,2299.2539251175217
RWKV/rwkv-raven-7b,38.25693186890057,214.35460040295501,5.09708168833379,1112.947044996645
Neutralzz/BiLLa-7B-SFT,31.761691850702793,160.1222296843519,4.935750165560669,783.9250990597718
StabilityAI/stablelm-tuned-alpha-7b,28.53967935283584,242.85829415715244,8.213054464106607,1349.8225080590983
h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,30.275817945748678,216.17797179314977,6.902688020302885,1083.431902955002
metaai/llama-13B,17.273409248575422,76.56447280053727,3.7837350834271555,772.3963885157816
metaai/llama-7B,26.078374550887073,65.01040967092008,2.106037566082945,335.8834066487579
openaccess-ai-collective/manticore-13b-chat-pyg,21.385993003768778,293.6336467427804,13.589340266513748,2717.3955362659517
camel-ai/CAMEL-13B-Combined-Data,21.443262786761146,292.39724647414374,13.597516823282726,3063.6723606447304
lmsys/fastchat-t5-3b-v1.0,17.285271119159383,312.98119543317665,24.00358150668783,1150.395621558095
lmsys/vicuna-13B,21.71511101442676,278.87676292813967,12.8324168655423,2980.6725436534525
project-baize/baize-v2-7B,30.553878516266057,324.9533243787777,10.401131271597677,1837.7422095365996
tatsu-lab/alpaca-7B,30.30927551611021,130.43619879113498,4.1233307988468715,727.2185275352584
BAIR/koala-7b,32.54393862793764,261.6477501678979,7.92655260342141,1308.97298321021
FreedomIntelligence/phoenix-inst-chat-7b,43.255453591642365,241.45936870382806,5.358263290288085,1212.8509496306262
OpenAssistant/oasst-sft-1-pythia-12b,15.360072232285452,256.2988582941571,16.199311907878233,2513.5866148421774
databricks/dolly-v2-12b,14.8711288386801,151.2726662189389,9.739419852054695,1458.1875147750186
lmsys/vicuna-7B,32.13252691172293,283.11618535930154,8.759656009372382,1458.5311544660867
nomic-ai/gpt4all-13b-snoozy,21.59345917467568,244.30624580255204,11.242197763509727,2265.4151793149776
togethercomputer/RedPajama-INCITE-7B-Chat,22.218321996015874,278.4751511081263,11.953991510078367,1661.3254805238432
Salesforce/xgen-7b-8k-inst,37.91403759725149,273.3502350570853,7.256534066994451,1327.9763411685672