Spaces:
Running
Running
| model,throughput,response_length,latency,energy | |
| metaai/llama-13B,23.078188347142518,114.53055742108798,4.394399051080669,930.4217461383607 | |
| metaai/llama-7B,28.422054486839865,106.21793149764943,3.3668744317152224,578.5248918737578 | |
| BAIR/koala-13b,25.68238710094553,169.5476830087307,6.410479635487899,1266.6891084620372 | |
| BAIR/koala-7b,33.328275305359796,195.68065815983883,5.765067746732124,865.7973959032869 | |
| RWKV/rwkv-raven-7b,66.0701614426915,226.21087978509067,3.1888684277266397,805.043430490258 | |
| FreedomIntelligence/phoenix-inst-chat-7b,53.984465765624535,195.5295500335796,3.4296249723803256,847.9469607118755 | |
| camel-ai/CAMEL-13B-Combined-Data,25.753539426678923,188.12894560107455,7.247808498485511,1586.241547011427 | |
| databricks/dolly-v2-12b,24.68014979695401,155.27535258562793,5.997897220429992,1098.335702149091 | |
| h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,32.5833896491562,213.57656145063802,6.531293810193048,968.5605910006633 | |
| lmsys/fastchat-t5-3b-v1.0,35.32774199941168,284.15748824714575,12.138674304558975,1073.3059664204081 | |
| lmsys/vicuna-13B,26.34627305992005,195.90799194089993,7.373395581162019,1657.1269066487612 | |
| lmsys/vicuna-7B,33.203726764981546,213.17058428475488,6.385267472888481,1042.905993955669 | |
| tatsu-lab/alpaca-7B,32.842417001177665,122.1242444593687,3.6588753698446244,569.2690120886454 | |
| Neutralzz/BiLLa-7B-SFT,31.28470885552271,103.00335795836132,3.208946741549069,494.7404388851737 | |
| nomic-ai/gpt4all-13b-snoozy,25.76578508237939,121.15312290127602,4.545457045249276,994.3254654130169 | |
| openaccess-ai-collective/manticore-13b-chat-pyg,26.392333822580962,227.33378106111485,8.568163497332025,1738.897591336476 | |
| OpenAssistant/oasst-sft-1-pythia-12b,24.824754847354107,236.00940228341167,9.223680323395048,1834.861354264594 | |
| project-baize/baize-v2-7B,31.451660882452277,241.78945601074545,7.49180176517012,1276.267568838159 | |
| StabilityAI/stablelm-tuned-alpha-7b,44.77280320960753,224.9724647414372,4.834958684556046,1105.6361689053056 | |
| togethercomputer/RedPajama-INCITE-7B-Chat,26.907685411875395,276.31497649429144,9.836634313501508,1464.5413824714485 | |
| Salesforce/xgen-7b-8k-inst,44.663943769832876,274.27333781061117,6.187109905653467,1280.4384345198118 | |