# Dataset Card for "kjj0/4chanpol"

**Warning: offensive content.**

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by [Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board](https://arxiv.org/abs/2001.07487).
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We additionally provide a variant which includes OpenAI moderation scores at [kjj0/4chanpol-openaimod](https://huggingface.co/datasets/kjj0/4chanpol-openaimod).

Our purpose for creating this dataset, along with the OpenAI predictions (which are fairly accurate)
is to cheaply obtain a massive labeled text dataset (albeit with some unpleasant content) in order
to do research on data selection, active learning, label noise, and training curricula.

```
@inproceedings{papasavva2020raiders,
  title={Raiders of the lost kek: 3.5 years of augmented 4chan posts from the politically incorrect board},
  author={Papasavva, Antonis and Zannettou, Savvas and De Cristofaro, Emiliano and Stringhini, Gianluca and Blackburn, Jeremy},
  booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
  volume={14},
  pages={885--894},
  year={2020}
}
```
arxiv:2001.07487 region:us
{"dataset_info": {"features": [{"name": "text", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 17193959653, "num_examples": 114647404}], "download_size": 11559500898, "dataset_size": 17193959653}}
TAGS
#arxiv-2001.07487 #region-us 

# Dataset Card for "kjj0/4chanpol"

Warning: offensive content.

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board.
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We additionally provide a variant which includes OpenAI moderation scores at kjj0/4chanpol-openaimod.

Our purpose for creating this dataset, along with the OpenAI predictions (which are fairly accurate)
is to cheaply obtain a massive labeled text dataset (albeit with some unpleasant content) in order
to do research on data selection, active learning, label noise, and training curricula.


# Dataset Card for "kjj0/4chanpol"

Warning: offensive content.

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board.
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We additionally provide a variant which includes OpenAI moderation scores at kjj0/4chanpol-openaimod.

Our purpose for creating this dataset, along with the OpenAI predictions (which are fairly accurate)
is to cheaply obtain a massive labeled text dataset (albeit with some unpleasant content) in order
to do research on data selection, active learning, label noise, and training curricula.
TAGS
#arxiv-2001.07487 #region-us 
 # Dataset Card for "kjj0/4chanpol"

Warning: offensive content.

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board.
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We additionally provide a variant which includes OpenAI moderation scores at kjj0/4chanpol-openaimod.

Our purpose for creating this dataset, along with the OpenAI predictions (which are fairly accurate)
is to cheaply obtain a massive labeled text dataset (albeit with some unpleasant content) in order
to do research on data selection, active learning, label noise, and training curricula.