
# Dataset Card for [Dataset Name]

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** [LAReQA](https://github.com/google-research-datasets/lareqa)
- **Repository:** [XQuAD-R](https://github.com/google-research-datasets/lareqa)
- **Paper:** [LAReQA: Language-agnostic answer retrieval from a multilingual pool](https://arxiv.org/pdf/2004.05484.pdf)
- **Point of Contact:** [Noah Constant](mailto:nconstant@google.com)


### Dataset Summary
 
XQuAD-R is a retrieval version of the XQuAD dataset (a cross-lingual extractive
QA dataset). Like XQuAD, XQUAD-R is an 11-way parallel dataset,  where each
question appears in 11 different languages and has 11 parallel correct answers
across the languages.


### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

The dataset can be found with the following languages:
* Arabic: `xquad-r/ar.json`
* German: `xquad-r/de.json`
* Greek: `xquad-r/el.json`
* English: `xquad-r/en.json`
* Spanish: `xquad-r/es.json`
* Hindi: `xquad-r/hi.json`
* Russian: `xquad-r/ru.json`
* Thai: `xquad-r/th.json`
* Turkish: `xquad-r/tr.json`
* Vietnamese: `xquad-r/vi.json`
* Chinese: `xquad-r/zh.json`

## Dataset Structure

[More Information Needed]

### Data Instances

An example from `en` config:
```
{'id': '56beb4343aeaaa14008c925b',
 'context': "The Panthers defense gave up just 308 points, ranking sixth in the league, while also leading the NFL in interceptions with 24 and boasting four Pro Bowl selections. Pro Bowl defensive tackle Kawann Short led the team in sacks with 11, while also forcing three fumbles and recovering two. Fellow lineman Mario Addison added 6½ sacks. The Panthers line also featured veteran defensive end Jared Allen, a 5-time pro bowler who was the NFL's active career sack leader with 136, along with defensive end Kony Ealy, who had 5 sacks in just 9 starts. Behind them, two of the Panthers three starting linebackers were also selected to play in the Pro Bowl: Thomas Davis and Luke Kuechly. Davis compiled 5½ sacks, four forced fumbles, and four interceptions, while Kuechly led the team in tackles (118) forced two fumbles, and intercepted four passes of his own. Carolina's secondary featured Pro Bowl safety Kurt Coleman, who led the team with a career high seven interceptions, while also racking up 88 tackles and Pro Bowl cornerback Josh Norman, who developed into a shutdown corner during the season and had four interceptions, two of which were returned for touchdowns.",
 'question': 'How many points did the Panthers defense surrender?',
 'answers': {'text': ['308'], 'answer_start': [34]}}
```

### Data Fields

- `id` (`str`): Unique ID for the context-question pair.
- `context` (`str`): Context for the question.
- `question` (`str`): Question.
- `answers` (`dict`): Answers with the following keys:
  - `text` (`list` of `str`): Texts of the answers.
  - `answer_start` (`list` of `int`): Start positions for every answer text.

### Data Splits

The number of questions and candidate sentences for each language for XQuAD-R is shown in the table below:

|     | XQuAD-R   |            |
|-----|-----------|------------|
|     | questions | candidates |
| ar |      1190 |       1222 |
| de |      1190 |       1276 |
| el |      1190 |       1234 |
| en |      1190 |       1180 |
| es |      1190 |       1215 |
| hi |      1190 |       1244 |
| ru |      1190 |       1219 |
| th |      1190 |        852 |
| tr |      1190 |       1167 |
| vi |      1190 |       1209 |
| zh |      1190 |       1196 |

## Dataset Creation

[More Information Needed]

### Curation Rationale

[More Information Needed]

### Source Data

[More Information Needed]

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

[More Information Needed]

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

[More Information Needed]

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

[More Information Needed]

### Dataset Curators

The dataset was initially created by Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips and Yinfei Yang, during work done at Google Research.

### Licensing Information

XQuAD-R is distributed under the [CC BY-SA 4.0 license](https://creativecommons.org/licenses/by-sa/4.0/legalcode).

### Citation Information

```
@article{roy2020lareqa,
  title={LAReQA: Language-agnostic answer retrieval from a multilingual pool},
  author={Roy, Uma and Constant, Noah and Al-Rfou, Rami and Barua, Aditya and Phillips, Aaron and Yang, Yinfei},
  journal={arXiv preprint arXiv:2004.05484},
  year={2020}
}
```

### Contributions

Thanks to [@manandey](https://github.com/manandey) for adding this dataset.
task_categories:question-answering task_ids:extractive-qa annotations_creators:expert-generated language_creators:found multilinguality:multilingual size_categories:1K<n<10K source_datasets:extended|squad source_datasets:extended|xquad language:ar language:de language:el language:en language:es language:hi language:ru language:th language:tr language:vi language:zh license:cc-by-sa-4.0 arxiv:2004.05484 region:us
{"annotations_creators": ["expert-generated"], "language_creators": ["found"], "language": ["ar", "de", "el", "en", "es", "hi", "ru", "th", "tr", "vi", "zh"], "license": ["cc-by-sa-4.0"], "multilinguality": ["multilingual"], "size_categories": ["1K<n<10K"], "source_datasets": ["extended|squad", "extended|xquad"], "task_categories": ["question-answering"], "task_ids": ["extractive-qa"], "paperswithcode_id": "xquad-r", "pretty_name": "LAReQA", "config_names": ["ar", "de", "el", "en", "es", "hi", "ru", "th", "tr", "vi", "zh"], "dataset_info": [{"config_name": "ar", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1722775, "num_examples": 1190}], "download_size": 263002, "dataset_size": 1722775}, {"config_name": "de", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1283277, "num_examples": 1190}], "download_size": 241957, "dataset_size": 1283277}, {"config_name": "el", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 2206666, "num_examples": 1190}], "download_size": 324379, "dataset_size": 2206666}, {"config_name": "en", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1116099, "num_examples": 1190}], "download_size": 212372, "dataset_size": 1116099}, {"config_name": "es", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1273475, "num_examples": 1190}], "download_size": 236874, "dataset_size": 1273475}, {"config_name": "hi", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 2682951, "num_examples": 1190}], "download_size": 322083, "dataset_size": 2682951}, {"config_name": "ru", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 2136966, "num_examples": 1190}], "download_size": 321728, "dataset_size": 2136966}, {"config_name": "th", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 2854935, "num_examples": 1190}], "download_size": 337307, "dataset_size": 2854935}, {"config_name": "tr", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1210739, "num_examples": 1190}], "download_size": 228364, "dataset_size": 1210739}, {"config_name": "vi", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 1477215, "num_examples": 1190}], "download_size": 237644, "dataset_size": 1477215}, {"config_name": "zh", "features": [{"name": "id", "dtype": "string"}, {"name": "context", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "answers", "sequence": [{"name": "text", "dtype": "string"}, {"name": "answer_start", "dtype": "int32"}]}], "splits": [{"name": "validation", "num_bytes": 984217, "num_examples": 1190}], "download_size": 205768, "dataset_size": 984217}], "configs": [{"config_name": "ar", "data_files": [{"split": "validation", "path": "ar/validation-*"}]}, {"config_name": "de", "data_files": [{"split": "validation", "path": "de/validation-*"}]}, {"config_name": "el", "data_files": [{"split": "validation", "path": "el/validation-*"}]}, {"config_name": "en", "data_files": [{"split": "validation", "path": "en/validation-*"}]}, {"config_name": "es", "data_files": [{"split": "validation", "path": "es/validation-*"}]}, {"config_name": "hi", "data_files": [{"split": "validation", "path": "hi/validation-*"}]}, {"config_name": "ru", "data_files": [{"split": "validation", "path": "ru/validation-*"}]}, {"config_name": "th", "data_files": [{"split": "validation", "path": "th/validation-*"}]}, {"config_name": "tr", "data_files": [{"split": "validation", "path": "tr/validation-*"}]}, {"config_name": "vi", "data_files": [{"split": "validation", "path": "vi/validation-*"}]}, {"config_name": "zh", "data_files": [{"split": "validation", "path": "zh/validation-*"}]}]}
TAGS
#task_categories-question-answering #task_ids-extractive-qa #annotations_creators-expert-generated #language_creators-found #multilinguality-multilingual #size_categories-1K<n<10K #source_datasets-extended|squad #source_datasets-extended|xquad #language-Arabic #language-German #language-Modern Greek (1453-) #language-English #language-Spanish #language-Hindi #language-Russian #language-Thai #language-Turkish #language-Vietnamese #language-Chinese #license-cc-by-sa-4.0 #arxiv-2004.05484 #region-us 

Dataset Card for [Dataset Name]
===============================


Table of Contents
-----------------


* Dataset Description
	+ Dataset Summary
	+ Supported Tasks and Leaderboards
	+ Languages
* Dataset Structure
	+ Data Instances
	+ Data Fields
	+ Data Splits
* Dataset Creation
	+ Curation Rationale
	+ Source Data
	+ Annotations
	+ Personal and Sensitive Information
* Considerations for Using the Data
	+ Social Impact of Dataset
	+ Discussion of Biases
	+ Other Known Limitations
* Additional Information
	+ Dataset Curators
	+ Licensing Information
	+ Citation Information
	+ Contributions


Dataset Description
-------------------


* Homepage: LAReQA
* Repository: XQuAD-R
* Paper: LAReQA: Language-agnostic answer retrieval from a multilingual pool
* Point of Contact: Noah Constant


### Dataset Summary


XQuAD-R is a retrieval version of the XQuAD dataset (a cross-lingual extractive
QA dataset). Like XQuAD, XQUAD-R is an 11-way parallel dataset, where each
question appears in 11 different languages and has 11 parallel correct answers
across the languages.


### Supported Tasks and Leaderboards


### Languages


The dataset can be found with the following languages:


* Arabic: 'xquad-r/URL'
* German: 'xquad-r/URL'
* Greek: 'xquad-r/URL'
* English: 'xquad-r/URL'
* Spanish: 'xquad-r/URL'
* Hindi: 'xquad-r/URL'
* Russian: 'xquad-r/URL'
* Thai: 'xquad-r/URL'
* Turkish: 'xquad-r/URL'
* Vietnamese: 'xquad-r/URL'
* Chinese: 'xquad-r/URL'


Dataset Structure
-----------------


### Data Instances


An example from 'en' config:


### Data Fields


* 'id' ('str'): Unique ID for the context-question pair.
* 'context' ('str'): Context for the question.
* 'question' ('str'): Question.
* 'answers' ('dict'): Answers with the following keys:
	+ 'text' ('list' of 'str'): Texts of the answers.
	+ 'answer\_start' ('list' of 'int'): Start positions for every answer text.


### Data Splits


The number of questions and candidate sentences for each language for XQuAD-R is shown in the table below:


XQuAD-R: 
XQuAD-R: ar
XQuAD-R: de
XQuAD-R: el
XQuAD-R: en
XQuAD-R: es
XQuAD-R: hi
XQuAD-R: ru
XQuAD-R: th
XQuAD-R: tr
XQuAD-R: vi
XQuAD-R: zh


Dataset Creation
----------------


### Curation Rationale


### Source Data


#### Initial Data Collection and Normalization


#### Who are the source language producers?


### Annotations


#### Annotation process


#### Who are the annotators?


### Personal and Sensitive Information


Considerations for Using the Data
---------------------------------


### Social Impact of Dataset


### Discussion of Biases


### Other Known Limitations


Additional Information
----------------------


### Dataset Curators


The dataset was initially created by Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips and Yinfei Yang, during work done at Google Research.


### Licensing Information


XQuAD-R is distributed under the CC BY-SA 4.0 license.


### Contributions


Thanks to @manandey for adding this dataset.



### Dataset Summary


XQuAD-R is a retrieval version of the XQuAD dataset (a cross-lingual extractive
QA dataset). Like XQuAD, XQUAD-R is an 11-way parallel dataset, where each
question appears in 11 different languages and has 11 parallel correct answers
across the languages. ### Supported Tasks and Leaderboards ### Languages


The dataset can be found with the following languages:


* Arabic: 'xquad-r/URL'
* German: 'xquad-r/URL'
* Greek: 'xquad-r/URL'
* English: 'xquad-r/URL'
* Spanish: 'xquad-r/URL'
* Hindi: 'xquad-r/URL'
* Russian: 'xquad-r/URL'
* Thai: 'xquad-r/URL'
* Turkish: 'xquad-r/URL'
* Vietnamese: 'xquad-r/URL'
* Chinese: 'xquad-r/URL'


Dataset Structure
----------------- ### Data Instances


An example from 'en' config: ### Data Fields


* 'id' ('str'): Unique ID for the context-question pair.
* 'context' ('str'): Context for the question.
* 'question' ('str'): Question.
* 'answers' ('dict'): Answers with the following keys:
	+ 'text' ('list' of 'str'): Texts of the answers.
	+ 'answer\_start' ('list' of 'int'): Start positions for every answer text. ### Data Splits


The number of questions and candidate sentences for each language for XQuAD-R is shown in the table below:


XQuAD-R: 
XQuAD-R: ar
XQuAD-R: de
XQuAD-R: el
XQuAD-R: en
XQuAD-R: es
XQuAD-R: hi
XQuAD-R: ru
XQuAD-R: th
XQuAD-R: tr
XQuAD-R: vi
XQuAD-R: zh


Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


The dataset was initially created by Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips and Yinfei Yang, during work done at Google Research. ### Licensing Information


XQuAD-R is distributed under the CC BY-SA 4.0 license. ### Contributions


Thanks to @manandey for adding this dataset.
TAGS
#task_categories-question-answering #task_ids-extractive-qa #annotations_creators-expert-generated #language_creators-found #multilinguality-multilingual #size_categories-1K<n<10K #source_datasets-extended|squad #source_datasets-extended|xquad #language-Arabic #language-German #language-Modern Greek (1453-) #language-English #language-Spanish #language-Hindi #language-Russian #language-Thai #language-Turkish #language-Vietnamese #language-Chinese #license-cc-by-sa-4.0 #arxiv-2004.05484 #region-us 
 ### Dataset Summary


XQuAD-R is a retrieval version of the XQuAD dataset (a cross-lingual extractive
QA dataset). Like XQuAD, XQUAD-R is an 11-way parallel dataset, where each
question appears in 11 different languages and has 11 parallel correct answers
across the languages. ### Supported Tasks and Leaderboards ### Languages


The dataset can be found with the following languages:


* Arabic: 'xquad-r/URL'
* German: 'xquad-r/URL'
* Greek: 'xquad-r/URL'
* English: 'xquad-r/URL'
* Spanish: 'xquad-r/URL'
* Hindi: 'xquad-r/URL'
* Russian: 'xquad-r/URL'
* Thai: 'xquad-r/URL'
* Turkish: 'xquad-r/URL'
* Vietnamese: 'xquad-r/URL'
* Chinese: 'xquad-r/URL'


Dataset Structure
----------------- ### Data Instances


An example from 'en' config: ### Data Fields


* 'id' ('str'): Unique ID for the context-question pair.
* 'context' ('str'): Context for the question.
* 'question' ('str'): Question.
* 'answers' ('dict'): Answers with the following keys:
	+ 'text' ('list' of 'str'): Texts of the answers.
	+ 'answer\_start' ('list' of 'int'): Start positions for every answer text. ### Data Splits


The number of questions and candidate sentences for each language for XQuAD-R is shown in the table below:


XQuAD-R: 
XQuAD-R: ar
XQuAD-R: de
XQuAD-R: el
XQuAD-R: en
XQuAD-R: es
XQuAD-R: hi
XQuAD-R: ru
XQuAD-R: th
XQuAD-R: tr
XQuAD-R: vi
XQuAD-R: zh


Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


The dataset was initially created by Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips and Yinfei Yang, during work done at Google Research. ### Licensing Information


XQuAD-R is distributed under the CC BY-SA 4.0 license. ### Contributions


Thanks to @manandey for adding this dataset.
passage: TAGS
#task_categories-question-answering #task_ids-extractive-qa #annotations_creators-expert-generated #language_creators-found #multilinguality-multilingual #size_categories-1K<n<10K #source_datasets-extended|squad #source_datasets-extended|xquad #language-Arabic #language-German #language-Modern Greek (1453-) #language-English #language-Spanish #language-Hindi #language-Russian #language-Thai #language-Turkish #language-Vietnamese #language-Chinese #license-cc-by-sa-4.0 #arxiv-2004.05484 #region-us 
### Dataset Summary


XQuAD-R is a retrieval version of the XQuAD dataset (a cross-lingual extractive
QA dataset). Like XQuAD, XQUAD-R is an 11-way parallel dataset, where each
question appears in 11 different languages and has 11 parallel correct answers
across the languages.### Supported Tasks and Leaderboards### Languages


The dataset can be found with the following languages:


* Arabic: 'xquad-r/URL'
* German: 'xquad-r/URL'
* Greek: 'xquad-r/URL'
* English: 'xquad-r/URL'
* Spanish: 'xquad-r/URL'
* Hindi: 'xquad-r/URL'
* Russian: 'xquad-r/URL'
* Thai: 'xquad-r/URL'
* Turkish: 'xquad-r/URL'
* Vietnamese: 'xquad-r/URL'
* Chinese: 'xquad-r/URL'


Dataset Structure
-----------------### Data Instances


An example from 'en' config: