Spaces:
Running
Running
Amber Tanaka
commited on
Update readme (#5)
Browse files- Ai2_logo_pink_padding_RGB.png +0 -0
- README.md +30 -0
Ai2_logo_pink_padding_RGB.png
DELETED
|
Binary file (62.9 kB)
|
|
|
README.md
CHANGED
|
@@ -13,3 +13,33 @@ failure_strategy: none
|
|
| 13 |
tags:
|
| 14 |
- leaderboard
|
| 15 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
tags:
|
| 14 |
- leaderboard
|
| 15 |
---
|
| 16 |
+
|
| 17 |
+
## Development
|
| 18 |
+
The leaderboard is built using the [HuggingFace Datasets](https://huggingface.co/docs/datasets/index) library, which provides a convenient way to manage and query datasets.
|
| 19 |
+
It's currently pointed at the [AstaBench Leaderboard](https://huggingface.co/datasets/allenai/asta-bench-internal-results/) dataset, which is a public dataset hosted on HuggingFace.
|
| 20 |
+
|
| 21 |
+
To run the leaderboard locally, you can use the following command:
|
| 22 |
+
|
| 23 |
+
```bash
|
| 24 |
+
python app.py
|
| 25 |
+
```
|
| 26 |
+
This will start a local server that you can access in your web browser at `http://localhost:7860`.
|
| 27 |
+
|
| 28 |
+
## Hugging Face Integration
|
| 29 |
+
This repo is already integrated with Hugging Face, please follow the steps below to push changes to the leaderboard on Hugging Face.
|
| 30 |
+
First make sure to merge your changes to the `main` branch of this repository. (following the standard GitHub workflow of creating a branch, making changes, and then merging it back to `main`).
|
| 31 |
+
First you need to add the Hugging Face remote repository if you haven't done so already. You can do this by running the following command:
|
| 32 |
+
|
| 33 |
+
```bash
|
| 34 |
+
git remote add huggingface https://huggingface.co/datasets/allenai/asta-bench-internal-results
|
| 35 |
+
```
|
| 36 |
+
You can verify that the remote has been added by running:
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
git remote -v
|
| 40 |
+
```
|
| 41 |
+
Then, to push the changes to the Hugging Face leaderboard, you can use the following command:
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
git push huggingface main:main
|
| 45 |
+
```
|