~10k conversations from Omegle. Scraped using: http://web.archive.org/cdx/search/xd?url=logs.omegle.com/*&fl=timestamp,original,statuscode&output=json. For these logs to have ended up on the cdx, it means the url was posted publicly at some point. 
* PII removed by searching for conversations with these words: forbidden_words = ["kik", "telegram", "skype", "wickr", "discord", "dropbox", "insta ", "insta?", "instagram", "snap ", "snapchat"].
* Conversations with racial slurs removed.
* English only.
* Obviously, the dataset still contains a lot of (sometimes extreme) NSFW content. Do not view or use this dataset if you are under 18.

General process for scraping (There are probably other datasets that can be scraped using this method):
1. Go to page in archive.org cdx
2. Check if the page contains a log
3. Download the log image
4. Use OCR to read it
5. Save it to a json file.

This dataset could be useful for training casual conversational AI's but it likely still requires more filtering. Use at your own risk.
language:en license:apache-2.0 region:us
{"language": ["en"], "license": "apache-2.0"}
TAGS
#language-English #license-apache-2.0 #region-us 

~10k conversations from Omegle. Scraped using: URL For these logs to have ended up on the cdx, it means the url was posted publicly at some point. 
* PII removed by searching for conversations with these words: forbidden_words = ["kik", "telegram", "skype", "wickr", "discord", "dropbox", "insta ", "insta?", "instagram", "snap ", "snapchat"].
* Conversations with racial slurs removed.
* English only.
* Obviously, the dataset still contains a lot of (sometimes extreme) NSFW content. Do not view or use this dataset if you are under 18.

General process for scraping (There are probably other datasets that can be scraped using this method):
1. Go to page in URL cdx
2. Check if the page contains a log
3. Download the log image
4. Use OCR to read it
5. Save it to a json file.

This dataset could be useful for training casual conversational AI's but it likely still requires more filtering. Use at your own risk.
TAGS
#language-English #license-apache-2.0 #region-us 

passage: TAGS
#language-English #license-apache-2.0 #region-us 
