model,throughput,response_length,latency,energy
camel-ai/CAMEL-13B-Combined-Data,21.43101835743948,280.880120886501,13.064448516246319,2699.068023841508
lmsys/fastchat-t5-3b-v1.0,17.265044888298704,310.34318334452655,23.454799682692173,1043.990802216248
lmsys/vicuna-13B,21.221113733316532,268.2877770315648,12.474878561076359,2412.714352921421
lmsys/vicuna-7B,33.19220689261821,273.57118871725993,8.18447234641069,1387.838511417057
metaai/llama-7B,23.92946132846408,68.0584284754869,2.2809002959847486,354.6560946944264
project-baize/baize-v2-7B,30.350461249705614,313.3747481531229,10.034955017859746,1647.9252511752854
BAIR/koala-13b,21.426431872159036,253.86501007387508,11.723909422593445,2576.3193623237044
RWKV/rwkv-raven-7b,36.40036863259138,202.84654130288786,4.8940369672449,1139.9740564136987
FreedomIntelligence/phoenix-inst-chat-7b,42.268276726494044,233.5211551376763,5.210845160281831,1237.6637434519814
Neutralzz/BiLLa-7B-SFT,31.9073779709284,141.02820685023505,4.304014573938894,791.1183122901291
StabilityAI/stablelm-tuned-alpha-7b,27.433760323389556,241.67763599731364,8.396188638064837,1539.8807639355257
metaai/llama-13B,17.16666100714585,85.41638683680323,4.213923745980638,936.364457689723
openaccess-ai-collective/manticore-13b-chat-pyg,21.501265310987147,274.15983881799866,12.659875248785934,2867.592066151776
tatsu-lab/alpaca-7B,30.27856487351534,124.94392209536602,3.96404224254347,697.6676591672265
BAIR/koala-7b,31.656500750351455,247.8448623237072,7.693811395496254,1251.9351081262555
OpenAssistant/oasst-sft-1-pythia-12b,15.208750214131749,249.4513096037609,15.906977624923046,2461.867333445271
databricks/dolly-v2-12b,14.77422282257357,145.3566151779718,9.38322044956342,1392.614104096707
h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,31.09362733624043,213.68334452652786,6.7498229851656,1084.1301658831444
nomic-ai/gpt4all-13b-snoozy,21.536649161834035,212.530557421088,9.801092169845262,1977.1679271323053
togethercomputer/RedPajama-INCITE-7B-Chat,21.663817805785996,273.98455339153793,12.047950960830523,1659.1448901947638
Salesforce/xgen-7b-8k-inst,38.01892516162966,274.0402955003358,7.251852527010593,1449.515241101413