Jae-Won Chung commited on
Commit
1f4ddf2
1 Parent(s): a904b94

Add citation information (#32)

Browse files
Files changed (3) hide show
  1. README.md +22 -0
  2. app.py +16 -0
  3. docs/citation.bib +12 -0
README.md CHANGED
@@ -60,3 +60,25 @@ You can still run benchmarks without Pegasus like this:
60
  $ docker exec leaderboard0 python scripts/benchmark.py --model-path /data/leaderboard/weights/lmsys/vicuna-13B --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
61
  $ docker exec leaderboard0 python scripts/benchmark.py --model-path databricks/dolly-v2-12b --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
62
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
  $ docker exec leaderboard0 python scripts/benchmark.py --model-path /data/leaderboard/weights/lmsys/vicuna-13B --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
61
  $ docker exec leaderboard0 python scripts/benchmark.py --model-path databricks/dolly-v2-12b --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
62
  ```
63
+
64
+ ## Citation
65
+
66
+ For the ML.ENERGY Leaderboard:
67
+ ```bibtex
68
+ @misc{ml-energy-leaderboard,
69
+ author={Jae-Won Chung and Jiachen Liu and Zhiyu Wu and Yuxuan Xia and Mosharaf Chowdhury},
70
+ title={{ML.ENERGY} Leaderboard},
71
+ year={2023},
72
+ howpublished={\url{https://ml.energy/leaderboard}},
73
+ }
74
+ ```
75
+
76
+ For the [Zeus](https://ml.energy/zeus) framework used for benchmarking:
77
+ ```bibtex
78
+ @inproceedings{zeus:nsdi23,
79
+ author={Jie You and Jae-Won Chung and Mosharaf Chowdhury},
80
+ booktitle={USENIX NSDI},
81
+ title={Zeus: Understanding and Optimizing {GPU} Energy Consumption of {DNN} Training},
82
+ year={2023},
83
+ }
84
+ ```
app.py CHANGED
@@ -357,6 +357,11 @@ table th:first-child {
357
  pointer-events: none;
358
  opacity: 0.4;
359
  }
 
 
 
 
 
360
  """
361
 
362
  intro_text = """
@@ -790,6 +795,17 @@ with gr.Blocks(css=custom_css) as block:
790
  # Read in LEADERBOARD.md
791
  gr.Markdown(open("docs/leaderboard.md").read())
792
 
 
 
 
 
 
 
 
 
 
 
 
793
  # Load the table on page load.
794
  block.load(on_load, outputs=[dataframe, model_preference_dropdown], queue=False)
795
 
 
357
  pointer-events: none;
358
  opacity: 0.4;
359
  }
360
+
361
+ /* Make the Citation header larger */
362
+ #citation-header > div > span {
363
+ font-size: 16px !important;
364
+ }
365
  """
366
 
367
  intro_text = """
 
795
  # Read in LEADERBOARD.md
796
  gr.Markdown(open("docs/leaderboard.md").read())
797
 
798
+ # Citation
799
+ with gr.Accordion("📚 Citation", open=False, elem_id="citation-header"):
800
+ citation_text = open("docs/citation.bib").read()
801
+ gr.Textbox(
802
+ value=citation_text,
803
+ label="BibTeX for the leaderboard and the Zeus framework used for benchmarking:",
804
+ lines=len(list(filter(lambda c: c == "\n", citation_text))),
805
+ interactive=False,
806
+ show_copy_button=True,
807
+ )
808
+
809
  # Load the table on page load.
810
  block.load(on_load, outputs=[dataframe, model_preference_dropdown], queue=False)
811
 
docs/citation.bib ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ @misc{ml-energy-leaderboard,
2
+ author={Jae-Won Chung and Jiachen Liu and Zhiyu Wu and Yuxuan Xia and Mosharaf Chowdhury},
3
+ title={{ML.ENERGY} Leaderboard},
4
+ year={2023},
5
+ howpublished={\url{https://ml.energy/leaderboard}},
6
+ }
7
+ @inproceedings{zeus:nsdi23,
8
+ author={Jie You and Jae-Won Chung and Mosharaf Chowdhury},
9
+ booktitle={USENIX NSDI},
10
+ title={Zeus: Understanding and Optimizing {GPU} Energy Consumption of {DNN} Training},
11
+ year={2023},
12
+ }