Spaces:
Running
Running
| model,throughput,response_length,latency,energy | |
| camel-ai/CAMEL-13B-Combined-Data,21.43101835743948,280.880120886501,13.064448516246319,2699.068023841508 | |
| lmsys/fastchat-t5-3b-v1.0,17.265044888298704,310.34318334452655,23.454799682692173,1043.990802216248 | |
| lmsys/vicuna-13B,21.221113733316532,268.2877770315648,12.474878561076359,2412.714352921421 | |
| lmsys/vicuna-7B,33.19220689261821,273.57118871725993,8.18447234641069,1387.838511417057 | |
| metaai/llama-7B,23.92946132846408,68.0584284754869,2.2809002959847486,354.6560946944264 | |
| project-baize/baize-v2-7B,30.350461249705614,313.3747481531229,10.034955017859746,1647.9252511752854 | |
| BAIR/koala-13b,21.426431872159036,253.86501007387508,11.723909422593445,2576.3193623237044 | |
| RWKV/rwkv-raven-7b,36.40036863259138,202.84654130288786,4.8940369672449,1139.9740564136987 | |
| FreedomIntelligence/phoenix-inst-chat-7b,42.268276726494044,233.5211551376763,5.210845160281831,1237.6637434519814 | |
| Neutralzz/BiLLa-7B-SFT,31.9073779709284,141.02820685023505,4.304014573938894,791.1183122901291 | |
| StabilityAI/stablelm-tuned-alpha-7b,27.433760323389556,241.67763599731364,8.396188638064837,1539.8807639355257 | |
| metaai/llama-13B,17.16666100714585,85.41638683680323,4.213923745980638,936.364457689723 | |
| openaccess-ai-collective/manticore-13b-chat-pyg,21.501265310987147,274.15983881799866,12.659875248785934,2867.592066151776 | |
| tatsu-lab/alpaca-7B,30.27856487351534,124.94392209536602,3.96404224254347,697.6676591672265 | |
| BAIR/koala-7b,31.656500750351455,247.8448623237072,7.693811395496254,1251.9351081262555 | |
| OpenAssistant/oasst-sft-1-pythia-12b,15.208750214131749,249.4513096037609,15.906977624923046,2461.867333445271 | |
| databricks/dolly-v2-12b,14.77422282257357,145.3566151779718,9.38322044956342,1392.614104096707 | |
| h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,31.09362733624043,213.68334452652786,6.7498229851656,1084.1301658831444 | |
| nomic-ai/gpt4all-13b-snoozy,21.536649161834035,212.530557421088,9.801092169845262,1977.1679271323053 | |
| togethercomputer/RedPajama-INCITE-7B-Chat,21.663817805785996,273.98455339153793,12.047950960830523,1659.1448901947638 | |