model,throughput,response_length,latency,energy
BAIR/koala-7b,31.870929688850776,191.7407656145064,5.776933217154402,940.6980705171267
RWKV/rwkv-raven-7b,39.221009432980566,226.7229684351914,5.369737004086241,1264.4471417058417
FreedomIntelligence/phoenix-inst-chat-7b,42.470186422244424,193.91034251175284,4.339222575622636,968.785210208196
lmsys/fastchat-t5-3b-v1.0,32.731683961001515,280.61417058428475,13.955027274680319,699.2501370047005
lmsys/vicuna-13B,21.749876946304724,194.72666218938886,8.894261652518159,2004.231935191404
metaai/llama-13B,18.570015239967084,117.85896574882472,5.5800629816924205,1151.47489355272
metaai/llama-7B,26.579538100451405,104.01846877098724,3.3514236870209313,594.7948838146413
nomic-ai/gpt4all-13b-snoozy,20.983074234487425,124.95735392881129,5.782305658279372,1160.8125960376083
togethercomputer/RedPajama-INCITE-7B-Chat,22.13375331287594,273.00067159167224,11.777779012989532,1618.0334294828767
StabilityAI/stablelm-tuned-alpha-7b,29.00482449092475,223.56044325050368,7.41862470058361,1333.2689402283406
camel-ai/CAMEL-13B-Combined-Data,21.460150389563363,188.2263263935527,8.713883080348563,1952.1352001343216
databricks/dolly-v2-12b,14.910884049151369,157.10543989254532,10.048765299306664,1523.7667649429138
lmsys/vicuna-7B,33.00422508114337,218.19845533915378,6.521462410481351,1134.2387068502344
openaccess-ai-collective/manticore-13b-chat-pyg,21.69738931527289,229.17763599731364,10.522901259287245,2290.821816655476
BAIR/koala-13b,20.97945489282466,168.6877098723976,7.777735522072535,1462.6801752854299
Neutralzz/BiLLa-7B-SFT,30.656448666055088,99.96474143720617,3.1034504787446604,493.75409200805854
OpenAssistant/oasst-sft-1-pythia-12b,15.311911635208784,239.28374748153124,15.189281238389173,2210.647578240437
h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,30.99540256126542,217.50503693754197,6.9492957234086985,1093.5390379449263
project-baize/baize-v2-7B,30.171092209096468,243.02182672934856,7.826149599316017,1279.5043529214238
tatsu-lab/alpaca-7B,32.01702487024256,119.6296171927468,3.623346220601726,576.9808673606445
Salesforce/xgen-7b-8k-inst,38.467648583908094,274.2149093351242,7.175161660318009,1445.4932884486213