gpt-2-output-dataset

This dataset contains:

250K samples from the WebText test set
For each GPT-2 model (trained on the WebText training set), 250K plain samples (temperature 1, no truncation) and 250K samples generated with top-k 40 truncation

We look forward to the research produced using this data!

For each, we have a training split of 500K total examples, as well as validation and test splits of 10K examples.

All data is located in Google Cloud Storage, at under the directory gs://gpt-2/output-dataset/v1.

There, you will find files:

where split is one of train, test, and valid.

We've provided a script to download all of them, in download_dataset.py.

We're interested in seeing research in detectability of our model generations.

We've provided a starter baseline which trains a logistic regression detector on TF-IDF unigram and bigram features, in baseline.py.

If you believe your work is included in our dataset and would like us to remove it, please let us know at [email protected].