Hugging Face's logo

Spaces:
ml-energy
/
leaderboard
Running

App Files Community
3
leaderboard
File size: 757 Bytes 
2bd76a0
 
624d5c4
2bd76a0
e98ccc1
 
2bd76a0
 
 
19b22c9
 
 
 
 
 
 
 
 
 
 
 
 
a679cf2
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
 
---
title: ML.ENERGY Leaderboard
python_version: 3.9
app_file: app.py
sdk: gradio
sdk_version: 3.23.0
pinned: false
---

# ML.ENERGY Leaderboard

## Devs

Currently setup in `ampere02`:

1. Find model weights in `/data/leaderboard/weights/`, e.g. subdirectory `llama` and `vicuna`.

2. Let's share the Huggingface Transformer cache:

```bash
export TRANSFORMERS_CACHE=/data/leaderboard/hfcache
```

Run benchmarks like this:

```console
$ python benchmark.py --model-path /data/leaderboard/weights/lmsys/vicuna-7B --input-file /data/leaderboard/sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled.json
$ python benchmark.py --model-path databricks/dolly-v2-12b --input-file /data/leaderboard/sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled.json
```