model,throughput,response_length,latency,energy
BAIR/koala-13b,20.727175709016876,254.08025520483545,11.892537351481359,2191.190301544663
BAIR/koala-7b,25.954660733201525,259.2263263935527,9.768064146371243,1447.61525218268
RWKV/rwkv-raven-7b,61.486296272233105,244.58898589657488,3.6864172847628747,892.832628945603
FreedomIntelligence/phoenix-inst-chat-7b,55.22014703563219,221.38582941571525,3.8385676472189307,887.4773411685698
Neutralzz/BiLLa-7B-SFT,32.311906190353724,146.99966420416388,4.4437706789731255,750.0805171255877
OpenAssistant/oasst-sft-1-pythia-12b,24.935530057384018,250.45466756212224,9.786432366627167,2029.4657938213645
StabilityAI/stablelm-tuned-alpha-7b,45.08986296277073,232.79348556077903,4.994290238837428,1132.5013462055056
camel-ai/CAMEL-13B-Combined-Data,26.545864806820514,244.7578912021491,9.198450972152804,2025.3281155137665
databricks/dolly-v2-12b,22.230280077272955,161.52820685023505,8.256380503504923,1374.5864308260586
h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,32.73570790682367,219.56077904633983,6.708469191383511,1011.1683317662861
lmsys/fastchat-t5-3b-v1.0,33.043489972767865,355.22464741437204,15.602670499951651,1307.8302488247155
lmsys/vicuna-13B,21.00930585347828,266.4140362659503,12.326653083850998,2284.892455003353
lmsys/vicuna-7B,26.456122167045812,269.8492276695769,9.998248218763614,1393.5497108797765
metaai/llama-13B,22.701925773082262,99.55339153794493,3.953801921461699,853.2385591000668
metaai/llama-7B,29.32171747886574,107.48018804566823,3.322338972945185,561.9730688381476
nomic-ai/gpt4all-13b-snoozy,25.875636961002073,219.97582269979853,8.453523028629553,1718.9753918737365
openaccess-ai-collective/manticore-13b-chat-pyg,26.222449633250086,275.88179986568167,10.469822985415593,2115.522391537931
project-baize/baize-v2-7B,32.41073358811793,300.9086635325722,9.142081563219637,1529.693656480853
tatsu-lab/alpaca-7B,25.79378618278183,127.34217595701813,4.787391331217622,727.924358965749
togethercomputer/RedPajama-INCITE-7B-Chat,27.400950213545173,283.26158495634655,9.932342660383254,1629.655866689063
Salesforce/xgen-7b-8k-inst,48.57875587391399,273.65950302216254,5.67808680985901,1209.0622276695774