Spaces:
Running
Running
pratyushmaini
commited on
Commit
β’
1aacc3d
1
Parent(s):
d7ce1c0
Update app.py
Browse files
app.py
CHANGED
@@ -26,9 +26,10 @@ from plotter import create_plots
|
|
26 |
demo = gr.Blocks()
|
27 |
|
28 |
with demo:
|
29 |
-
gr.Markdown("
|
30 |
-
|
31 |
-
|
|
|
32 |
|
33 |
|
34 |
with gr.Tabs():
|
@@ -99,4 +100,34 @@ with demo:
|
|
99 |
)
|
100 |
|
101 |
# Launch the app
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
102 |
demo.launch()
|
|
|
26 |
demo = gr.Blocks()
|
27 |
|
28 |
with demo:
|
29 |
+
gr.Markdown("""
|
30 |
+
## π₯ TOFU Leaderboard
|
31 |
+
The TOFU dataset is a benchmark designed to evaluate the unlearning performance of large language models in realistic scenarios. This unique dataset consists of question-answer pairs that are based on the autobiographies of 200 fictitious authors, entirely generated by the GPT-4 model. The primary objective of this task is to effectively unlearn a fine-tuned model using different portions of the forget set.
|
32 |
+
""")
|
33 |
|
34 |
|
35 |
with gr.Tabs():
|
|
|
100 |
)
|
101 |
|
102 |
# Launch the app
|
103 |
+
|
104 |
+
gr.Markdown("""
|
105 |
+
## Applicability π
|
106 |
+
|
107 |
+
The dataset is in QA format, making it ideal for use with popular chat models such as Llama2, Mistral, or Qwen. However, it also works for any other large language model. The corresponding code base is written for the Llama2 model, but can be easily adapted to other models.
|
108 |
+
|
109 |
+
## Installation
|
110 |
+
|
111 |
+
```
|
112 |
+
conda create -n tofu python=3.10
|
113 |
+
conda activate tofu
|
114 |
+
conda install pytorch pytorch-cuda=11.8 -c pytorch -c nvidia
|
115 |
+
conda install -c "nvidia/label/cuda-11.8.0" cuda-toolkit
|
116 |
+
pip install -r requirements.txt
|
117 |
+
```
|
118 |
+
|
119 |
+
## Loading the Dataset
|
120 |
+
|
121 |
+
To load the dataset, use the following code:
|
122 |
+
|
123 |
+
```python
|
124 |
+
from datasets import load_dataset
|
125 |
+
dataset = load_dataset("locuslab/TOFU","full")
|
126 |
+
```
|
127 |
+
|
128 |
+
### Push to Leaderboard
|
129 |
+
|
130 |
+
How to push your results to the leaderboard?
|
131 |
+
|
132 |
+
""")
|
133 |
demo.launch()
|