Alec commited on
Commit
9972fb3
1 Parent(s): 8101eff

update readme

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -8,9 +8,7 @@ We look forward to the research produced using this data!
8
 
9
  ### Download
10
 
11
- For each, we have a training split of 250K samples, as well as validation and test splits of 5K samples.
12
-
13
- For each model, we're releasing temperature 1 samples
14
 
15
  All data is located in Google Cloud Storage, at under the directory `gs://gpt-2/output-dataset/v1`.
16
 
@@ -34,7 +32,14 @@ We've provided a script to download all of them, in `download_dataset.py`.
34
 
35
  We're interested in seeing research in detectability of our model generations.
36
 
37
- We've provided a baseline of logistic regression on tf-idf, in `baseline.py`.
 
 
 
 
 
 
 
38
 
39
  ### Data removal requests
40
 
 
8
 
9
  ### Download
10
 
11
+ For each, we have a training split of 500K total examples, as well as validation and test splits of 10K examples.
 
 
12
 
13
  All data is located in Google Cloud Storage, at under the directory `gs://gpt-2/output-dataset/v1`.
14
 
 
32
 
33
  We're interested in seeing research in detectability of our model generations.
34
 
35
+ We've provided a starter baseline which trains a logistic regression detector on TF-IDF unigram and bigram features, in `baseline.py`.
36
+
37
+ | Model | Temperature 1 | Top-K 40 |
38
+ | ----- | ------ | ------ |
39
+ | 117M | 88.29% | 96.79% |
40
+ | 345M | 88.94% | 95.22% |
41
+ | 762M | 77.16% | 94.43% |
42
+ | 1542M | 74.31% | 92.69% |
43
 
44
  ### Data removal requests
45