pratyushmaini commited on
Commit
1aacc3d
β€’
1 Parent(s): d7ce1c0

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +34 -3
app.py CHANGED
@@ -26,9 +26,10 @@ from plotter import create_plots
26
  demo = gr.Blocks()
27
 
28
  with demo:
29
- gr.Markdown("## πŸ₯‡ TOFU Leaderboard
30
- The TOFU dataset serves as a benchmark for evaluating the unlearning performance of large language models on realistic tasks. The dataset comprises question-answer pairs based on autobiographies of 200 different authors that do not exist and are completely fictitiously generated by the GPT-4 model. The goal of the task is to unlearn a fine-tuned model on various fractions of the forget set.")
31
-
 
32
 
33
 
34
  with gr.Tabs():
@@ -99,4 +100,34 @@ with demo:
99
  )
100
 
101
  # Launch the app
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
102
  demo.launch()
 
26
  demo = gr.Blocks()
27
 
28
  with demo:
29
+ gr.Markdown("""
30
+ ## πŸ₯‡ TOFU Leaderboard
31
+ The TOFU dataset is a benchmark designed to evaluate the unlearning performance of large language models in realistic scenarios. This unique dataset consists of question-answer pairs that are based on the autobiographies of 200 fictitious authors, entirely generated by the GPT-4 model. The primary objective of this task is to effectively unlearn a fine-tuned model using different portions of the forget set.
32
+ """)
33
 
34
 
35
  with gr.Tabs():
 
100
  )
101
 
102
  # Launch the app
103
+
104
+ gr.Markdown("""
105
+ ## Applicability πŸš€
106
+
107
+ The dataset is in QA format, making it ideal for use with popular chat models such as Llama2, Mistral, or Qwen. However, it also works for any other large language model. The corresponding code base is written for the Llama2 model, but can be easily adapted to other models.
108
+
109
+ ## Installation
110
+
111
+ ```
112
+ conda create -n tofu python=3.10
113
+ conda activate tofu
114
+ conda install pytorch pytorch-cuda=11.8 -c pytorch -c nvidia
115
+ conda install -c "nvidia/label/cuda-11.8.0" cuda-toolkit
116
+ pip install -r requirements.txt
117
+ ```
118
+
119
+ ## Loading the Dataset
120
+
121
+ To load the dataset, use the following code:
122
+
123
+ ```python
124
+ from datasets import load_dataset
125
+ dataset = load_dataset("locuslab/TOFU","full")
126
+ ```
127
+
128
+ ### Push to Leaderboard
129
+
130
+ How to push your results to the leaderboard?
131
+
132
+ """)
133
  demo.launch()