ROOTS Subset: roots_pt_wikipedia

# wikipedia

- Dataset uid: `wikipedia`

### Description



### Homepage



### Licensing



### Speaker Locations



### Sizes

- 3.2299 % of total
- 4.2071 % of en
- 5.6773 % of ar
- 3.3416 % of fr
- 5.2815 % of es
- 12.4852 % of ca
- 0.4288 % of zh
- 0.4286 % of zh
- 5.4743 % of indic-bn
- 8.9062 % of indic-ta
- 21.3313 % of indic-te
- 4.4845 % of pt
- 4.0493 % of indic-hi
- 11.3163 % of indic-ml
- 22.5300 % of indic-ur
- 4.4902 % of vi
- 16.9916 % of indic-kn
- 24.7820 % of eu
- 11.6241 % of indic-mr
- 9.8749 % of id
- 9.3489 % of indic-pa
- 9.4767 % of indic-gu
- 24.1132 % of indic-as
- 5.3309 % of indic-or

### BigScience processing steps

#### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: ar

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: ca

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: zh



#### Filters applied to: zh



#### Filters applied to: indic-bn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ta

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-te

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-hi

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ml

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ur

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-kn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: eu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-mr

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-pa

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-gu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-as

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-or

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs


language:pt license:cc-by-sa-3.0 region:us
{"language": "pt", "license": "cc-by-sa-3.0", "extra_gated_prompt": "By accessing this dataset, you agree to abide by the BigScience Ethical Charter. The charter can be found at:\nhttps://hf.co/spaces/bigscience/ethical-charter", "extra_gated_fields": {"I have read and agree to abide by the BigScience Ethical Charter": "checkbox"}}
TAGS
#language-Portuguese #license-cc-by-sa-3.0 #region-us 

ROOTS Subset: roots_pt_wikipedia

# wikipedia

- Dataset uid: 'wikipedia'

### Description



### Homepage



### Licensing



### Speaker Locations



### Sizes

- 3.2299 % of total
- 4.2071 % of en
- 5.6773 % of ar
- 3.3416 % of fr
- 5.2815 % of es
- 12.4852 % of ca
- 0.4288 % of zh
- 0.4286 % of zh
- 5.4743 % of indic-bn
- 8.9062 % of indic-ta
- 21.3313 % of indic-te
- 4.4845 % of pt
- 4.0493 % of indic-hi
- 11.3163 % of indic-ml
- 22.5300 % of indic-ur
- 4.4902 % of vi
- 16.9916 % of indic-kn
- 24.7820 % of eu
- 11.6241 % of indic-mr
- 9.8749 % of id
- 9.3489 % of indic-pa
- 9.4767 % of indic-gu
- 24.1132 % of indic-as
- 5.3309 % of indic-or

### BigScience processing steps

#### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: ar

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: ca

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: zh



#### Filters applied to: zh



#### Filters applied to: indic-bn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ta

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-te

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-hi

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ml

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ur

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-kn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: eu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-mr

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-pa

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-gu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-as

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-or

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs


# wikipedia

- Dataset uid: 'wikipedia' ### Description ### Homepage ### Licensing ### Speaker Locations ### Sizes

- 3.2299 % of total
- 4.2071 % of en
- 5.6773 % of ar
- 3.3416 % of fr
- 5.2815 % of es
- 12.4852 % of ca
- 0.4288 % of zh
- 0.4286 % of zh
- 5.4743 % of indic-bn
- 8.9062 % of indic-ta
- 21.3313 % of indic-te
- 4.4845 % of pt
- 4.0493 % of indic-hi
- 11.3163 % of indic-ml
- 22.5300 % of indic-ur
- 4.4902 % of vi
- 16.9916 % of indic-kn
- 24.7820 % of eu
- 11.6241 % of indic-mr
- 9.8749 % of id
- 9.3489 % of indic-pa
- 9.4767 % of indic-gu
- 24.1132 % of indic-as
- 5.3309 % of indic-or ### BigScience processing steps #### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: ar

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: ca

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: zh #### Filters applied to: zh #### Filters applied to: indic-bn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ta

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-te

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-hi

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ml

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ur

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-kn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: eu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs #### Filters applied to: indic-mr

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-pa

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-gu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-as

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs #### Filters applied to: indic-or

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
TAGS
#language-Portuguese #license-cc-by-sa-3.0 #region-us 
 # wikipedia

- Dataset uid: 'wikipedia' ### Description ### Homepage ### Licensing ### Speaker Locations ### Sizes

- 3.2299 % of total
- 4.2071 % of en
- 5.6773 % of ar
- 3.3416 % of fr
- 5.2815 % of es
- 12.4852 % of ca
- 0.4288 % of zh
- 0.4286 % of zh
- 5.4743 % of indic-bn
- 8.9062 % of indic-ta
- 21.3313 % of indic-te
- 4.4845 % of pt
- 4.0493 % of indic-hi
- 11.3163 % of indic-ml
- 22.5300 % of indic-ur
- 4.4902 % of vi
- 16.9916 % of indic-kn
- 24.7820 % of eu
- 11.6241 % of indic-mr
- 9.8749 % of id
- 9.3489 % of indic-pa
- 9.4767 % of indic-gu
- 24.1132 % of indic-as
- 5.3309 % of indic-or ### BigScience processing steps #### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: ar

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: ca

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024 #### Filters applied to: zh #### Filters applied to: zh #### Filters applied to: indic-bn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ta

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-te

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-hi

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ml

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-ur

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-kn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: eu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs #### Filters applied to: indic-mr

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-pa

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-gu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300 #### Filters applied to: indic-as

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs #### Filters applied to: indic-or

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
passage: TAGS
#language-Portuguese #license-cc-by-sa-3.0 #region-us 
# wikipedia

- Dataset uid: 'wikipedia'### Description### Homepage### Licensing### Speaker Locations### Sizes

- 3.2299 % of total
- 4.2071 % of en
- 5.6773 % of ar
- 3.3416 % of fr
- 5.2815 % of es
- 12.4852 % of ca
- 0.4288 % of zh
- 0.4286 % of zh
- 5.4743 % of indic-bn
- 8.9062 % of indic-ta
- 21.3313 % of indic-te
- 4.4845 % of pt
- 4.0493 % of indic-hi
- 11.3163 % of indic-ml
- 22.5300 % of indic-ur
- 4.4902 % of vi
- 16.9916 % of indic-kn
- 24.7820 % of eu
- 11.6241 % of indic-mr
- 9.8749 % of id
- 9.3489 % of indic-pa
- 9.4767 % of indic-gu
- 24.1132 % of indic-as
- 5.3309 % of indic-or### BigScience processing steps#### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024#### Filters applied to: ar

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024#### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024#### Filters applied to: ca

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024#### Filters applied to: zh#### Filters applied to: zh passage: #### Filters applied to: indic-bn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-ta

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-te

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-hi

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-ml

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-ur

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: indic-kn

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: eu

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs#### Filters applied to: indic-mr

- filter_wiki_user_titles
- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300#### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300