We are excited to share the release of the HumanMOD dataset, unveiled in our [AMCIS 2023 paper ](https://aisel.aisnet.org/amcis2023/sig_aiaa/sig_aiaa/3). 

Wang, Kanlun; Fu, Zhe; Zhou, Lina; and Zhang, Dongsong, "How Does User Engagement Support Content Moderation? A Deep Learning-based Comparative Study" (2023). AMCIS 2023 Proceedings. 3.
https://aisel.aisnet.org/amcis2023/sig_aiaa/sig_aiaa/3

Dataset Summary:

- The data collection was limited to public online communities to comply with the platform's privacy policy. 
- We leveraged a [Pushshift Reddit API](https://reddit-api.readthedocs.io/en/latest/) to scrape posts from 40 subreddits daily across four different domains from Aug 24 to October 28, 2022, resulting in 104,674 posts. 
- To enhance the ecological validity of the study findings, we used a [PRAW API](https://praw.readthedocs.io/en/stable/) to perform another round of data collection of the collected posts 2 months later to validate whether the post content was moderated or not. 
- Thereafter, we used a snowballing approach to collect the corresponding comments on all the posts.
- The metadata includes post content, post time, comment content, comment time, karma score, etc.
- We set a threshold for the minimum number of comments to 2 and an upper bound for the number of direct comments to 15 to facilitate the extraction of graph-based structural information.
- The final dataset consists of 8,511 moderated posts and another 8,511 not moderated posts.
- All the posts were commented on, with a total of 148,344 comments.

Data Fields for HumanMOD_Posts dataset: 
- Reddit_ID: the unique identifiers for Reddit posts, which serve as the foreign keys bridging to the HumanMOD_Comments dataset.
- Subreddits: the names of subreddits
- Titles: the titles of Reddit posts
- Body: post content, which is an extended description of a post 
- Author: the authors of posts
- URLs: the web addresses of Reddit posts
- Labels: (0) -- The post is not moderated; (1) -- The post is moderated by moderators.

Data Fields for HumanMOD_Comments dataset: 
- Parent ID: the unique identifiers for parent comments
- Comment ID: the unique identifiers for child comments, the ones that reply to the parent comments
- Comment Body: the content of child comments
- Score: the karma scores of child comments
- Author: the authors of child comments
- Post ID: the specific Reddit post identifiers to which the child comment should be associated, which serve as the foreign keys bridging to the HumanMOD_Posts dataset.

task_categories:text-classification size_categories:10M<n<100M language:en region:us
{"language": ["en"], "size_categories": ["10M<n<100M"], "task_categories": ["text-classification"], "pretty_name": "HumanMOD (AMCIS 2023)"}
TAGS
#task_categories-text-classification #size_categories-10M<n<100M #language-English #region-us 

We are excited to share the release of the HumanMOD dataset, unveiled in our AMCIS 2023 paper . 

Wang, Kanlun; Fu, Zhe; Zhou, Lina; and Zhang, Dongsong, "How Does User Engagement Support Content Moderation? A Deep Learning-based Comparative Study" (2023). AMCIS 2023 Proceedings. 3.
URL

Dataset Summary:

- The data collection was limited to public online communities to comply with the platform's privacy policy. 
- We leveraged a Pushshift Reddit API to scrape posts from 40 subreddits daily across four different domains from Aug 24 to October 28, 2022, resulting in 104,674 posts. 
- To enhance the ecological validity of the study findings, we used a PRAW API to perform another round of data collection of the collected posts 2 months later to validate whether the post content was moderated or not. 
- Thereafter, we used a snowballing approach to collect the corresponding comments on all the posts.
- The metadata includes post content, post time, comment content, comment time, karma score, etc.
- We set a threshold for the minimum number of comments to 2 and an upper bound for the number of direct comments to 15 to facilitate the extraction of graph-based structural information.
- The final dataset consists of 8,511 moderated posts and another 8,511 not moderated posts.
- All the posts were commented on, with a total of 148,344 comments.

Data Fields for HumanMOD_Posts dataset: 
- Reddit_ID: the unique identifiers for Reddit posts, which serve as the foreign keys bridging to the HumanMOD_Comments dataset.
- Subreddits: the names of subreddits
- Titles: the titles of Reddit posts
- Body: post content, which is an extended description of a post 
- Author: the authors of posts
- URLs: the web addresses of Reddit posts
- Labels: (0) -- The post is not moderated; (1) -- The post is moderated by moderators.

Data Fields for HumanMOD_Comments dataset: 
- Parent ID: the unique identifiers for parent comments
- Comment ID: the unique identifiers for child comments, the ones that reply to the parent comments
- Comment Body: the content of child comments
- Score: the karma scores of child comments
- Author: the authors of child comments
- Post ID: the specific Reddit post identifiers to which the child comment should be associated, which serve as the foreign keys bridging to the HumanMOD_Posts dataset.

TAGS
#task_categories-text-classification #size_categories-10M<n<100M #language-English #region-us 

passage: TAGS
#task_categories-text-classification #size_categories-10M<n<100M #language-English #region-us 
