
# Dataset Card for NewsPH

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** [Filipino Text Benchmarks](https://github.com/jcblaisecruz02/Filipino-Text-Benchmarks)
- **Repository:**
- **Paper:** [Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation](https://arxiv.org/abs/2010.11574)
- **Leaderboard:**
- **Point of Contact:** [Jan Christian Blaise Cruz](jan_christian_cruz@dlsu.edu.ph)

### Dataset Summary

Raw collection of news articles in Filipino. Used to produce the NewsPH-NLI dataset in Cruz et al. (2020)

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

Tagalog/Filipino

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

- `text` (`str`)

The dataset is in plaintext and only has one field ("text"). It can be used for language modeling.

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

Thanks to [@jcblaisecruz02](https://github.com/jcblaisecruz02) for adding this dataset.
task_categories:text-generation task_categories:fill-mask task_ids:language-modeling task_ids:masked-language-modeling annotations_creators:no-annotation language_creators:found multilinguality:monolingual size_categories:1M<n<10M source_datasets:original language:fil language:tl license:gpl-3.0 arxiv:2010.11574 region:us
{"annotations_creators": ["no-annotation"], "language_creators": ["found"], "language": ["fil", "tl"], "license": ["gpl-3.0"], "multilinguality": ["monolingual"], "size_categories": ["1M<n<10M"], "source_datasets": ["original"], "task_categories": ["text-generation", "fill-mask"], "task_ids": ["language-modeling", "masked-language-modeling"], "paperswithcode_id": "newsph-nli", "pretty_name": "NewsPH-NLI", "dataset_info": {"features": [{"name": "text", "dtype": "string"}], "config_name": "newsph", "splits": [{"name": "train", "num_bytes": 298833914, "num_examples": 2190465}], "download_size": 104086466, "dataset_size": 298833914}}
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #annotations_creators-no-annotation #language_creators-found #multilinguality-monolingual #size_categories-1M<n<10M #source_datasets-original #language-Filipino #language-Tagalog #license-gpl-3.0 #arxiv-2010.11574 #region-us 


# Dataset Card for NewsPH

## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions

## Dataset Description

- Homepage: Filipino Text Benchmarks
- Repository:
- Paper: Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation
- Leaderboard:
- Point of Contact: Jan Christian Blaise Cruz

### Dataset Summary

Raw collection of news articles in Filipino. Used to produce the NewsPH-NLI dataset in Cruz et al. (2020)

### Supported Tasks and Leaderboards



### Languages

Tagalog/Filipino

## Dataset Structure

### Data Instances



### Data Fields

- 'text' ('str')

The dataset is in plaintext and only has one field ("text"). It can be used for language modeling.

### Data Splits



## Dataset Creation

### Curation Rationale



### Source Data

#### Initial Data Collection and Normalization



#### Who are the source language producers?



### Annotations

#### Annotation process



#### Who are the annotators?



### Personal and Sensitive Information



## Considerations for Using the Data

### Social Impact of Dataset



### Discussion of Biases



### Other Known Limitations



## Additional Information

### Dataset Curators



### Licensing Information







### Contributions

Thanks to @jcblaisecruz02 for adding this dataset.
# Dataset Card for NewsPH ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions ## Dataset Description

- Homepage: Filipino Text Benchmarks
- Repository:
- Paper: Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation
- Leaderboard:
- Point of Contact: Jan Christian Blaise Cruz ### Dataset Summary

Raw collection of news articles in Filipino. Used to produce the NewsPH-NLI dataset in Cruz et al. (2020) ### Supported Tasks and Leaderboards ### Languages

Tagalog/Filipino ## Dataset Structure ### Data Instances ### Data Fields

- 'text' ('str')

The dataset is in plaintext and only has one field ("text"). It can be used for language modeling. ### Data Splits ## Dataset Creation ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators ### Licensing Information ### Contributions

Thanks to @jcblaisecruz02 for adding this dataset.
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #annotations_creators-no-annotation #language_creators-found #multilinguality-monolingual #size_categories-1M<n<10M #source_datasets-original #language-Filipino #language-Tagalog #license-gpl-3.0 #arxiv-2010.11574 #region-us 
 # Dataset Card for NewsPH ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions ## Dataset Description

- Homepage: Filipino Text Benchmarks
- Repository:
- Paper: Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation
- Leaderboard:
- Point of Contact: Jan Christian Blaise Cruz ### Dataset Summary

Raw collection of news articles in Filipino. Used to produce the NewsPH-NLI dataset in Cruz et al. (2020) ### Supported Tasks and Leaderboards ### Languages

Tagalog/Filipino ## Dataset Structure ### Data Instances ### Data Fields

- 'text' ('str')

The dataset is in plaintext and only has one field ("text"). It can be used for language modeling. ### Data Splits ## Dataset Creation ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators ### Licensing Information ### Contributions

Thanks to @jcblaisecruz02 for adding this dataset.
passage: TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #annotations_creators-no-annotation #language_creators-found #multilinguality-monolingual #size_categories-1M<n<10M #source_datasets-original #language-Filipino #language-Tagalog #license-gpl-3.0 #arxiv-2010.11574 #region-us 
# Dataset Card for NewsPH## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions## Dataset Description

- Homepage: Filipino Text Benchmarks
- Repository:
- Paper: Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation
- Leaderboard:
- Point of Contact: Jan Christian Blaise Cruz### Dataset Summary

Raw collection of news articles in Filipino. Used to produce the NewsPH-NLI dataset in Cruz et al. (2020)### Supported Tasks and Leaderboards### Languages

Tagalog/Filipino## Dataset Structure### Data Instances### Data Fields

- 'text' ('str')

The dataset is in plaintext and only has one field ("text"). It can be used for language modeling.### Data Splits## Dataset Creation### Curation Rationale### Source Data#### Initial Data Collection and Normalization#### Who are the source language producers?### Annotations#### Annotation process#### Who are the annotators?### Personal and Sensitive Information## Considerations for Using the Data### Social Impact of Dataset