Spaces:
Running
Running
File size: 2,313 Bytes
360f81c 332f235 360f81c f0128b6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
model,throughput,response_length,latency,energy
openaccess-ai-collective/manticore-13b-chat-pyg,17.4993855646115,229.5795836131632,13.132503049058466,3501.182491605137
lmsys/vicuna-7B,29.046593546528904,212.760241773002,7.3296203452423265,1706.1712568838818
RWKV/rwkv-raven-7b,33.07481929862108,242.74177300201478,6.943508281124177,1787.5870651446628
tatsu-lab/alpaca-7B,29.475397017987323,117.95399597044997,3.9749026008906023,927.7634805239352
metaai/llama-13B,15.786345111463364,102.35762256548018,6.009854743435423,1590.8409496307413
OpenAssistant/oasst-sft-1-pythia-12b,16.03459728484094,241.31732706514438,14.686811677200872,3673.6327222969167
BAIR/koala-7b,29.75360600658546,200.51544660846204,6.658448294727219,1426.3522693082625
databricks/dolly-v2-12b,15.330621441395213,149.7411014103425,9.354867176525545,2240.8669214236447
togethercomputer/RedPajama-INCITE-7B-Chat,20.849945627496787,275.1017461383479,12.625316554842463,2521.5761004031265
BAIR/koala-13b,17.3129078938621,185.43653458697113,10.592529783475095,3058.9324654130387
metaai/llama-7B,26.263780879593444,96.94089993284084,3.35252434620665,871.9958969106643
lmsys/vicuna-13B,17.391771626218006,199.80960376091338,11.55835909586615,3031.3180846202845
camel-ai/CAMEL-13B-Combined-Data,17.27426964902266,194.22028206850234,11.174119858559074,2956.610076225849
FreedomIntelligence/phoenix-inst-chat-7b,32.63089093979437,197.44492948287441,5.895621189552368,1736.5409079919812
StabilityAI/stablelm-tuned-alpha-7b,26.523547972773766,244.16588314304903,8.984752658064695,2305.969679315211
h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,29.926231643904146,223.85426460711886,7.510739674653152,1676.2203126259078
Neutralzz/BiLLa-7B-SFT,29.118626503392385,104.97817327065144,3.5443721553023035,818.274197783844
nomic-ai/gpt4all-13b-snoozy,17.423064750595767,135.3938885157824,7.734149922101941,1871.6546057756862
project-baize/baize-v2-7B,28.13796712305154,262.9902619207522,9.250474432119292,2105.324460711873
lmsys/fastchat-t5-3b-v1.0,40.20822673632634,281.74110141034254,10.492163513616964,1110.3276249158694
metaai/Llama-2-13b-chat-hf,16.753336372767794,223.39019476158495,12.93183804940574,2423.302869711249
metaai/Llama-2-7b-chat-hf,30.95799874634315,220.83680322364003,6.815573463441101,1288.2125369376631
|