ROOTS Subset: roots_id_indo4b_jw300

# indo4b_jw300

- Dataset uid: `indo4b_jw300`

### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n

### Homepage

https://www.indobenchmark.com/

### Licensing

MIT License

### Speaker Locations



### Sizes

- 0.0045 % of total
- 1.7307 % of id

### BigScience processing steps

#### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300


language:id license:cc-by-nc-sa-4.0 region:us
{"language": "id", "license": "cc-by-nc-sa-4.0", "extra_gated_prompt": "By accessing this dataset, you agree to abide by the BigScience Ethical Charter. The charter can be found at:\nhttps://hf.co/spaces/bigscience/ethical-charter", "extra_gated_fields": {"I have read and agree to abide by the BigScience Ethical Charter": "checkbox"}}
TAGS
#language-Indonesian #license-cc-by-nc-sa-4.0 #region-us 

ROOTS Subset: roots_id_indo4b_jw300

# indo4b_jw300

- Dataset uid: 'indo4b_jw300'

### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n

### Homepage

URL

### Licensing

MIT License

### Speaker Locations



### Sizes

- 0.0045 % of total
- 1.7307 % of id

### BigScience processing steps

#### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300


# indo4b_jw300

- Dataset uid: 'indo4b_jw300' ### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n ### Homepage

URL ### Licensing

MIT License ### Speaker Locations ### Sizes

- 0.0045 % of total
- 1.7307 % of id ### BigScience processing steps #### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300
TAGS
#language-Indonesian #license-cc-by-nc-sa-4.0 #region-us 
 # indo4b_jw300

- Dataset uid: 'indo4b_jw300' ### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n ### Homepage

URL ### Licensing

MIT License ### Speaker Locations ### Sizes

- 0.0045 % of total
- 1.7307 % of id ### BigScience processing steps #### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300
passage: TAGS
#language-Indonesian #license-cc-by-nc-sa-4.0 #region-us 
# indo4b_jw300

- Dataset uid: 'indo4b_jw300'### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n### Homepage

URL### Licensing

MIT License### Speaker Locations### Sizes

- 0.0045 % of total
- 1.7307 % of id### BigScience processing steps#### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300