
# Dataset Card for OLM September/October 2022 Common Crawl

Cleaned and deduplicated pretraining dataset, created with the OLM repo [here](https://github.com/huggingface/olm-datasets) from 16% of the September/October 2022 Common Crawl snapshot.

Note: `last_modified_timestamp` was parsed from whatever a website returned in it's `Last-Modified` header; there are likely a small number of outliers that are incorrect, so we recommend removing the outliers before doing statistics with `last_modified_timestamp`.
annotations_creators:no-annotation language_creators:found multilinguality:monolingual size_categories:10M<n<100M language:en pretraining language modelling common crawl web region:us
{"annotations_creators": ["no-annotation"], "language_creators": ["found"], "language": ["en"], "license": [], "multilinguality": ["monolingual"], "size_categories": ["10M<n<100M"], "source_datasets": [], "task_categories": [], "task_ids": [], "pretty_name": "OLM September/October 2022 Common Crawl", "tags": ["pretraining", "language modelling", "common crawl", "web"]}
TAGS
#annotations_creators-no-annotation #language_creators-found #multilinguality-monolingual #size_categories-10M<n<100M #language-English #pretraining #language modelling #common crawl #web #region-us 


# Dataset Card for OLM September/October 2022 Common Crawl

Cleaned and deduplicated pretraining dataset, created with the OLM repo here from 16% of the September/October 2022 Common Crawl snapshot.

Note: 'last_modified_timestamp' was parsed from whatever a website returned in it's 'Last-Modified' header; there are likely a small number of outliers that are incorrect, so we recommend removing the outliers before doing statistics with 'last_modified_timestamp'.
# Dataset Card for OLM September/October 2022 Common Crawl

Cleaned and deduplicated pretraining dataset, created with the OLM repo here from 16% of the September/October 2022 Common Crawl snapshot.

Note: 'last_modified_timestamp' was parsed from whatever a website returned in it's 'Last-Modified' header; there are likely a small number of outliers that are incorrect, so we recommend removing the outliers before doing statistics with 'last_modified_timestamp'.
TAGS
#annotations_creators-no-annotation #language_creators-found #multilinguality-monolingual #size_categories-10M<n<100M #language-English #pretraining #language modelling #common crawl #web #region-us 
 # Dataset Card for OLM September/October 2022 Common Crawl

Cleaned and deduplicated pretraining dataset, created with the OLM repo here from 16% of the September/October 2022 Common Crawl snapshot.

Note: 'last_modified_timestamp' was parsed from whatever a website returned in it's 'Last-Modified' header; there are likely a small number of outliers that are incorrect, so we recommend removing the outliers before doing statistics with 'last_modified_timestamp'.