
# Dataset Card for "indic_glue"

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://ai4bharat.iitm.ac.in/indic-glue
- **Repository:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Paper:** [IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages](https://aclanthology.org/2020.findings-emnlp.445/)
- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Size of downloaded dataset files:** 3.51 GB
- **Size of the generated dataset:** 1.65 GB
- **Total amount of disk used:** 5.16 GB

### Dataset Summary

IndicGLUE is a natural language understanding benchmark for Indian languages. It contains a wide
variety of tasks and covers 11 major Indian languages - as, bn, gu, hi, kn, ml, mr, or, pa, ta, te.

The Winograd Schema Challenge (Levesque et al., 2011) is a reading comprehension task
in which a system must read a sentence with a pronoun and select the referent of that pronoun from
a list of choices. The examples are manually constructed to foil simple statistical methods: Each
one is contingent on contextual information provided by a single word or phrase in the sentence.
To convert the problem into sentence pair classification, we construct sentence pairs by replacing
the ambiguous pronoun with each possible referent. The task is to predict if the sentence with the
pronoun substituted is entailed by the original sentence. We use a small evaluation set consisting of
new examples derived from fiction books that was shared privately by the authors of the original
corpus. While the included training set is balanced between two classes, the test set is imbalanced
between them (65% not entailment). Also, due to a data quirk, the development set is adversarial:
hypotheses are sometimes shared between training and development examples, so if a model memorizes the
training examples, they will predict the wrong label on corresponding development set
example. As with QNLI, each example is evaluated separately, so there is not a systematic correspondence
between a model's score on this task and its score on the unconverted original task. We
call converted dataset WNLI (Winograd NLI). This dataset is translated and publicly released for 3
Indian languages by AI4Bharat.

### Supported Tasks and Leaderboards

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Languages

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Dataset Structure

### Data Instances

#### actsa-sc.te

- **Size of downloaded dataset files:** 0.38 MB
- **Size of the generated dataset:** 1.71 MB
- **Total amount of disk used:** 2.09 MB

An example of 'validation' looks as follows.
```
This example was too long and was cropped:

{
    "label": 0,
    "text": "\"ప్రయాణాల్లో ఉన్నవారికోసం బస్ స్టేషన్లు, రైల్వే స్టేషన్లలో పల్స్పోలియో బూతులను ఏర్పాటు చేసి చిన్నారులకు పోలియో చుక్కలు వేసేలా ఏర..."
}
```

#### bbca.hi

- **Size of downloaded dataset files:** 5.77 MB
- **Size of the generated dataset:** 27.63 MB
- **Total amount of disk used:** 33.40 MB

An example of 'train' looks as follows.
```
This example was too long and was cropped:

{
    "label": "pakistan",
    "text": "\"नेटिजन यानि इंटरनेट पर सक्रिय नागरिक अब ट्विटर पर सरकार द्वारा लगाए प्रतिबंधों के समर्थन या विरोध में अपने विचार व्यक्त करते है..."
}
```

#### copa.en

- **Size of downloaded dataset files:** 0.75 MB
- **Size of the generated dataset:** 0.12 MB
- **Total amount of disk used:** 0.87 MB

An example of 'validation' looks as follows.
```
{
    "choice1": "I swept the floor in the unoccupied room.",
    "choice2": "I shut off the light in the unoccupied room.",
    "label": 1,
    "premise": "I wanted to conserve energy.",
    "question": "effect"
}
```

#### copa.gu

- **Size of downloaded dataset files:** 0.75 MB
- **Size of the generated dataset:** 0.23 MB
- **Total amount of disk used:** 0.99 MB

An example of 'train' looks as follows.
```
This example was too long and was cropped:

{
    "choice1": "\"સ્ત્રી જાણતી હતી કે તેનો મિત્ર મુશ્કેલ સમયમાંથી પસાર થઈ રહ્યો છે.\"...",
    "choice2": "\"મહિલાને લાગ્યું કે તેના મિત્રએ તેની દયાળુ લાભ લીધો છે.\"...",
    "label": 0,
    "premise": "મહિલાએ તેના મિત્રની મુશ્કેલ વર્તન સહન કરી.",
    "question": "cause"
}
```

#### copa.hi

- **Size of downloaded dataset files:** 0.75 MB
- **Size of the generated dataset:** 0.23 MB
- **Total amount of disk used:** 0.99 MB

An example of 'validation' looks as follows.
```
{
    "choice1": "मैंने उसका प्रस्ताव ठुकरा दिया।",
    "choice2": "उन्होंने मुझे उत्पाद खरीदने के लिए राजी किया।",
    "label": 0,
    "premise": "मैंने सेल्समैन की पिच पर शक किया।",
    "question": "effect"
}
```

### Data Fields

The data fields are the same among all splits.

#### actsa-sc.te
- `text`: a `string` feature.
- `label`: a classification label, with possible values including `positive` (0), `negative` (1).

#### bbca.hi
- `label`: a `string` feature.
- `text`: a `string` feature.

#### copa.en
- `premise`: a `string` feature.
- `choice1`: a `string` feature.
- `choice2`: a `string` feature.
- `question`: a `string` feature.
- `label`: a `int32` feature.

#### copa.gu
- `premise`: a `string` feature.
- `choice1`: a `string` feature.
- `choice2`: a `string` feature.
- `question`: a `string` feature.
- `label`: a `int32` feature.

#### copa.hi
- `premise`: a `string` feature.
- `choice1`: a `string` feature.
- `choice2`: a `string` feature.
- `question`: a `string` feature.
- `label`: a `int32` feature.

### Data Splits

#### actsa-sc.te

|           |train|validation|test|
|-----------|----:|---------:|---:|
|actsa-sc.te| 4328|       541| 541|

#### bbca.hi

|       |train|test|
|-------|----:|---:|
|bbca.hi| 3467| 866|

#### copa.en

|       |train|validation|test|
|-------|----:|---------:|---:|
|copa.en|  400|       100| 500|

#### copa.gu

|       |train|validation|test|
|-------|----:|---------:|---:|
|copa.gu|  362|        88| 448|

#### copa.hi

|       |train|validation|test|
|-------|----:|---------:|---:|
|copa.hi|  362|        88| 449|

## Dataset Creation

### Curation Rationale

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the source language producers?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Annotations

#### Annotation process

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the annotators?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Personal and Sensitive Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Discussion of Biases

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Other Known Limitations

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Additional Information

### Dataset Curators

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Licensing Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Citation Information

```
@inproceedings{kakwani-etal-2020-indicnlpsuite,
    title = "{I}ndic{NLPS}uite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for {I}ndian Languages",
    author = "Kakwani, Divyanshu  and
      Kunchukuttan, Anoop  and
      Golla, Satish  and
      N.C., Gokul  and
      Bhattacharyya, Avik  and
      Khapra, Mitesh M.  and
      Kumar, Pratyush",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2020",
    month = nov,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2020.findings-emnlp.445",
    doi = "10.18653/v1/2020.findings-emnlp.445",
    pages = "4948--4961",
}

@inproceedings{Levesque2011TheWS,
title={The Winograd Schema Challenge},
author={H. Levesque and E. Davis and L. Morgenstern},
booktitle={KR},
year={2011}
}
```

### Contributions

Thanks to [@sumanthd17](https://github.com/sumanthd17) for adding this dataset.
task_categories:text-classification task_categories:token-classification task_categories:multiple-choice task_ids:topic-classification task_ids:natural-language-inference task_ids:sentiment-analysis task_ids:semantic-similarity-scoring task_ids:named-entity-recognition task_ids:multiple-choice-qa annotations_creators:other language_creators:found multilinguality:multilingual size_categories:100K<n<1M source_datasets:extended|other language:as language:bn language:en language:gu language:hi language:kn language:ml language:mr language:or language:pa language:ta language:te license:other discourse-mode-classification paraphrase-identification cross-lingual-similarity headline-classification region:us
{"annotations_creators": ["other"], "language_creators": ["found"], "language": ["as", "bn", "en", "gu", "hi", "kn", "ml", "mr", "or", "pa", "ta", "te"], "license": ["other"], "multilinguality": ["multilingual"], "size_categories": ["100K<n<1M"], "source_datasets": ["extended|other"], "task_categories": ["text-classification", "token-classification", "multiple-choice"], "task_ids": ["topic-classification", "natural-language-inference", "sentiment-analysis", "semantic-similarity-scoring", "named-entity-recognition", "multiple-choice-qa"], "pretty_name": "IndicGLUE", "tags": ["discourse-mode-classification", "paraphrase-identification", "cross-lingual-similarity", "headline-classification"], "dataset_info": [{"config_name": "actsa-sc.te", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "positive", "1": "negative"}}}}], "splits": [{"name": "train", "num_bytes": 1370907, "num_examples": 4328}, {"name": "validation", "num_bytes": 166089, "num_examples": 541}, {"name": "test", "num_bytes": 168291, "num_examples": 541}], "download_size": 727630, "dataset_size": 1705287}, {"config_name": "bbca.hi", "features": [{"name": "label", "dtype": "string"}, {"name": "text", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 22126205, "num_examples": 3467}, {"name": "test", "num_bytes": 5501148, "num_examples": 866}], "download_size": 10349015, "dataset_size": 27627353}, {"config_name": "copa.en", "features": [{"name": "premise", "dtype": "string"}, {"name": "choice1", "dtype": "string"}, {"name": "choice2", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "label", "dtype": "int32"}], "splits": [{"name": "train", "num_bytes": 46033, "num_examples": 400}, {"name": "validation", "num_bytes": 11679, "num_examples": 100}, {"name": "test", "num_bytes": 55846, "num_examples": 500}], "download_size": 79431, "dataset_size": 113558}, {"config_name": "copa.gu", "features": [{"name": "premise", "dtype": "string"}, {"name": "choice1", "dtype": "string"}, {"name": "choice2", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "label", "dtype": "int32"}], "splits": [{"name": "train", "num_bytes": 92097, "num_examples": 362}, {"name": "validation", "num_bytes": 23450, "num_examples": 88}, {"name": "test", "num_bytes": 109997, "num_examples": 448}], "download_size": 107668, "dataset_size": 225544}, {"config_name": "copa.hi", "features": [{"name": "premise", "dtype": "string"}, {"name": "choice1", "dtype": "string"}, {"name": "choice2", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "label", "dtype": "int32"}], "splits": [{"name": "train", "num_bytes": 93376, "num_examples": 362}, {"name": "validation", "num_bytes": 23559, "num_examples": 88}, {"name": "test", "num_bytes": 112830, "num_examples": 449}], "download_size": 104233, "dataset_size": 229765}, {"config_name": "copa.mr", "features": [{"name": "premise", "dtype": "string"}, {"name": "choice1", "dtype": "string"}, {"name": "choice2", "dtype": "string"}, {"name": "question", "dtype": "string"}, {"name": "label", "dtype": "int32"}], "splits": [{"name": "train", "num_bytes": 93441, "num_examples": 362}, {"name": "validation", "num_bytes": 23874, "num_examples": 88}, {"name": "test", "num_bytes": 112055, "num_examples": 449}], "download_size": 105962, "dataset_size": 229370}, {"config_name": "csqa.as", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 3800523, "num_examples": 2942}], "download_size": 1390423, "dataset_size": 3800523}, {"config_name": "csqa.bn", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 54671018, "num_examples": 38845}], "download_size": 19648180, "dataset_size": 54671018}, {"config_name": "csqa.gu", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 29131607, "num_examples": 22861}], "download_size": 6027825, "dataset_size": 29131607}, {"config_name": "csqa.hi", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 40409347, "num_examples": 35140}], "download_size": 14711258, "dataset_size": 40409347}, {"config_name": "csqa.kn", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 21199816, "num_examples": 13666}], "download_size": 7669655, "dataset_size": 21199816}, {"config_name": "csqa.ml", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 47220836, "num_examples": 26537}], "download_size": 17382215, "dataset_size": 47220836}, {"config_name": "csqa.mr", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 13667174, "num_examples": 11370}], "download_size": 5072738, "dataset_size": 13667174}, {"config_name": "csqa.or", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 2562365, "num_examples": 1975}], "download_size": 948046, "dataset_size": 2562365}, {"config_name": "csqa.pa", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 5806097, "num_examples": 5667}], "download_size": 2194109, "dataset_size": 5806097}, {"config_name": "csqa.ta", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 61868481, "num_examples": 38590}], "download_size": 20789467, "dataset_size": 61868481}, {"config_name": "csqa.te", "features": [{"name": "question", "dtype": "string"}, {"name": "answer", "dtype": "string"}, {"name": "category", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "options", "sequence": "string"}, {"name": "out_of_context_options", "sequence": "string"}], "splits": [{"name": "test", "num_bytes": 58784997, "num_examples": 41338}], "download_size": 17447618, "dataset_size": 58784997}, {"config_name": "cvit-mkb-clsr.en-bn", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 1990957, "num_examples": 5522}], "download_size": 945551, "dataset_size": 1990957}, {"config_name": "cvit-mkb-clsr.en-gu", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 2303377, "num_examples": 6463}], "download_size": 1093313, "dataset_size": 2303377}, {"config_name": "cvit-mkb-clsr.en-hi", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 1855989, "num_examples": 5169}], "download_size": 890609, "dataset_size": 1855989}, {"config_name": "cvit-mkb-clsr.en-ml", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 1990089, "num_examples": 4886}], "download_size": 868956, "dataset_size": 1990089}, {"config_name": "cvit-mkb-clsr.en-mr", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 2130601, "num_examples": 5760}], "download_size": 993961, "dataset_size": 2130601}, {"config_name": "cvit-mkb-clsr.en-or", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 274873, "num_examples": 752}], "download_size": 134334, "dataset_size": 274873}, {"config_name": "cvit-mkb-clsr.en-ta", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 2565178, "num_examples": 5637}], "download_size": 1091653, "dataset_size": 2565178}, {"config_name": "cvit-mkb-clsr.en-te", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 1771129, "num_examples": 5049}], "download_size": 840410, "dataset_size": 1771129}, {"config_name": "cvit-mkb-clsr.en-ur", "features": [{"name": "sentence1", "dtype": "string"}, {"name": "sentence2", "dtype": "string"}], "splits": [{"name": "test", "num_bytes": 288430, "num_examples": 1006}], "download_size": 166129, "dataset_size": 288430}, {"config_name": "iitp-mr.hi", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "negative", "1": "neutral", "2": "positive"}}}}], "splits": [{"name": "train", "num_bytes": 6704905, "num_examples": 2480}, {"name": "validation", "num_bytes": 822218, "num_examples": 310}, {"name": "test", "num_bytes": 702373, "num_examples": 310}], "download_size": 3151762, "dataset_size": 8229496}, {"config_name": "iitp-pr.hi", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "negative", "1": "neutral", "2": "positive"}}}}], "splits": [{"name": "train", "num_bytes": 945589, "num_examples": 4182}, {"name": "validation", "num_bytes": 120100, "num_examples": 523}, {"name": "test", "num_bytes": 121910, "num_examples": 523}], "download_size": 509822, "dataset_size": 1187599}, {"config_name": "inltkh.gu", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entertainment", "1": "business", "2": "tech", "3": "sports", "4": "state", "5": "spirituality", "6": "tamil-cinema", "7": "positive", "8": "negative", "9": "neutral"}}}}], "splits": [{"name": "train", "num_bytes": 883063, "num_examples": 5269}, {"name": "validation", "num_bytes": 111201, "num_examples": 659}, {"name": "test", "num_bytes": 110757, "num_examples": 659}], "download_size": 515094, "dataset_size": 1105021}, {"config_name": "inltkh.ml", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entertainment", "1": "business", "2": "tech", "3": "sports", "4": "state", "5": "spirituality", "6": "tamil-cinema", "7": "positive", "8": "negative", "9": "neutral"}}}}], "splits": [{"name": "train", "num_bytes": 1108145, "num_examples": 5036}, {"name": "validation", "num_bytes": 140055, "num_examples": 630}, {"name": "test", "num_bytes": 138847, "num_examples": 630}], "download_size": 571019, "dataset_size": 1387047}, {"config_name": "inltkh.mr", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entertainment", "1": "business", "2": "tech", "3": "sports", "4": "state", "5": "spirituality", "6": "tamil-cinema", "7": "positive", "8": "negative", "9": "neutral"}}}}], "splits": [{"name": "train", "num_bytes": 1462614, "num_examples": 9672}, {"name": "validation", "num_bytes": 180306, "num_examples": 1210}, {"name": "test", "num_bytes": 180558, "num_examples": 1210}], "download_size": 840304, "dataset_size": 1823478}, {"config_name": "inltkh.ta", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entertainment", "1": "business", "2": "tech", "3": "sports", "4": "state", "5": "spirituality", "6": "tamil-cinema", "7": "positive", "8": "negative", "9": "neutral"}}}}], "splits": [{"name": "train", "num_bytes": 2659569, "num_examples": 5346}, {"name": "validation", "num_bytes": 316083, "num_examples": 669}, {"name": "test", "num_bytes": 320465, "num_examples": 669}], "download_size": 1271262, "dataset_size": 3296117}, {"config_name": "inltkh.te", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entertainment", "1": "business", "2": "tech", "3": "sports", "4": "state", "5": "spirituality", "6": "tamil-cinema", "7": "positive", "8": "negative", "9": "neutral"}}}}], "splits": [{"name": "train", "num_bytes": 1361667, "num_examples": 4328}, {"name": "validation", "num_bytes": 170471, "num_examples": 541}, {"name": "test", "num_bytes": 173149, "num_examples": 541}], "download_size": 726293, "dataset_size": 1705287}, {"config_name": "md.hi", "features": [{"name": "sentence", "dtype": "string"}, {"name": "discourse_mode", "dtype": "string"}, {"name": "story_number", "dtype": "int32"}, {"name": "id", "dtype": "int32"}], "splits": [{"name": "train", "num_bytes": 1672109, "num_examples": 7974}, {"name": "validation", "num_bytes": 211187, "num_examples": 997}, {"name": "test", "num_bytes": 210175, "num_examples": 997}], "download_size": 939801, "dataset_size": 2093471}, {"config_name": "sna.bn", "features": [{"name": "text", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "kolkata", "1": "state", "2": "national", "3": "sports", "4": "entertainment", "5": "international"}}}}], "splits": [{"name": "train", "num_bytes": 46070046, "num_examples": 11284}, {"name": "validation", "num_bytes": 5648126, "num_examples": 1411}, {"name": "test", "num_bytes": 5799979, "num_examples": 1411}], "download_size": 21415940, "dataset_size": 57518151}, {"config_name": "wiki-ner.as", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 374983, "num_examples": 1021}, {"name": "validation", "num_bytes": 49312, "num_examples": 157}, {"name": "test", "num_bytes": 50456, "num_examples": 160}], "download_size": 72919, "dataset_size": 474751}, {"config_name": "wiki-ner.bn", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 7502824, "num_examples": 20223}, {"name": "validation", "num_bytes": 988683, "num_examples": 2985}, {"name": "test", "num_bytes": 985941, "num_examples": 2690}], "download_size": 1278219, "dataset_size": 9477448}, {"config_name": "wiki-ner.gu", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 1571588, "num_examples": 2343}, {"name": "validation", "num_bytes": 192804, "num_examples": 297}, {"name": "test", "num_bytes": 197877, "num_examples": 255}], "download_size": 329660, "dataset_size": 1962269}, {"config_name": "wiki-ner.hi", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 3762505, "num_examples": 9463}, {"name": "validation", "num_bytes": 468678, "num_examples": 1114}, {"name": "test", "num_bytes": 475253, "num_examples": 1256}], "download_size": 948132, "dataset_size": 4706436}, {"config_name": "wiki-ner.kn", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 1352027, "num_examples": 2679}, {"name": "validation", "num_bytes": 179538, "num_examples": 412}, {"name": "test", "num_bytes": 180791, "num_examples": 476}], "download_size": 421877, "dataset_size": 1712356}, {"config_name": "wiki-ner.ml", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 7678887, "num_examples": 15620}, {"name": "validation", "num_bytes": 969947, "num_examples": 2067}, {"name": "test", "num_bytes": 991102, "num_examples": 2042}], "download_size": 2390442, "dataset_size": 9639936}, {"config_name": "wiki-ner.mr", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 5431489, "num_examples": 12151}, {"name": "validation", "num_bytes": 701637, "num_examples": 1498}, {"name": "test", "num_bytes": 655682, "num_examples": 1329}], "download_size": 1410663, "dataset_size": 6788808}, {"config_name": "wiki-ner.or", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 493758, "num_examples": 1077}, {"name": "validation", "num_bytes": 58568, "num_examples": 132}, {"name": "test", "num_bytes": 62211, "num_examples": 153}], "download_size": 102783, "dataset_size": 614537}, {"config_name": "wiki-ner.pa", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 520244, "num_examples": 1408}, {"name": "validation", "num_bytes": 61170, "num_examples": 186}, {"name": "test", "num_bytes": 61788, "num_examples": 179}], "download_size": 149727, "dataset_size": 643202}, {"config_name": "wiki-ner.ta", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 10117080, "num_examples": 20466}, {"name": "validation", "num_bytes": 1267188, "num_examples": 2586}, {"name": "test", "num_bytes": 1321626, "num_examples": 2611}], "download_size": 2819083, "dataset_size": 12705894}, {"config_name": "wiki-ner.te", "features": [{"name": "tokens", "sequence": "string"}, {"name": "ner_tags", "sequence": {"class_label": {"names": {"0": "B-LOC", "1": "B-ORG", "2": "B-PER", "3": "I-LOC", "4": "I-ORG", "5": "I-PER", "6": "O"}}}}, {"name": "additional_info", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 3881211, "num_examples": 7978}, {"name": "validation", "num_bytes": 458509, "num_examples": 841}, {"name": "test", "num_bytes": 507806, "num_examples": 1110}], "download_size": 1006881, "dataset_size": 4847526}, {"config_name": "wnli.en", "features": [{"name": "hypothesis", "dtype": "string"}, {"name": "premise", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "not_entailment", "1": "entailment", "2": "None"}}}}], "splits": [{"name": "train", "num_bytes": 104569, "num_examples": 635}, {"name": "validation", "num_bytes": 11878, "num_examples": 71}, {"name": "test", "num_bytes": 37297, "num_examples": 146}], "download_size": 57667, "dataset_size": 153744}, {"config_name": "wnli.gu", "features": [{"name": "hypothesis", "dtype": "string"}, {"name": "premise", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "not_entailment", "1": "entailment", "2": "None"}}}}], "splits": [{"name": "train", "num_bytes": 251554, "num_examples": 635}, {"name": "validation", "num_bytes": 28175, "num_examples": 71}, {"name": "test", "num_bytes": 94578, "num_examples": 146}], "download_size": 98032, "dataset_size": 374307}, {"config_name": "wnli.hi", "features": [{"name": "hypothesis", "dtype": "string"}, {"name": "premise", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "not_entailment", "1": "entailment", "2": "None"}}}}], "splits": [{"name": "train", "num_bytes": 253334, "num_examples": 635}, {"name": "validation", "num_bytes": 28676, "num_examples": 71}, {"name": "test", "num_bytes": 90823, "num_examples": 146}], "download_size": 99450, "dataset_size": 372833}, {"config_name": "wnli.mr", "features": [{"name": "hypothesis", "dtype": "string"}, {"name": "premise", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "not_entailment", "1": "entailment", "2": "None"}}}}], "splits": [{"name": "train", "num_bytes": 256649, "num_examples": 635}, {"name": "validation", "num_bytes": 29218, "num_examples": 71}, {"name": "test", "num_bytes": 97128, "num_examples": 146}], "download_size": 103774, "dataset_size": 382995}, {"config_name": "wstp.as", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 13581336, "num_examples": 5000}, {"name": "validation", "num_bytes": 1698968, "num_examples": 625}, {"name": "test", "num_bytes": 1697650, "num_examples": 626}], "download_size": 6959458, "dataset_size": 16977954}, {"config_name": "wstp.bn", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 143340457, "num_examples": 47580}, {"name": "validation", "num_bytes": 17759236, "num_examples": 5947}, {"name": "test", "num_bytes": 17633865, "num_examples": 5948}], "download_size": 69145372, "dataset_size": 178733558}, {"config_name": "wstp.gu", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 39353464, "num_examples": 10004}, {"name": "validation", "num_bytes": 4887752, "num_examples": 1251}, {"name": "test", "num_bytes": 4699158, "num_examples": 1251}], "download_size": 19763249, "dataset_size": 48940374}, {"config_name": "wstp.hi", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 158529578, "num_examples": 44069}, {"name": "validation", "num_bytes": 19371904, "num_examples": 5509}, {"name": "test", "num_bytes": 19593001, "num_examples": 5509}], "download_size": 77868574, "dataset_size": 197494483}, {"config_name": "wstp.kn", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 139950313, "num_examples": 35379}, {"name": "validation", "num_bytes": 17789782, "num_examples": 4422}, {"name": "test", "num_bytes": 17897031, "num_examples": 4423}], "download_size": 67719504, "dataset_size": 175637126}, {"config_name": "wstp.ml", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 88360504, "num_examples": 27527}, {"name": "validation", "num_bytes": 11193340, "num_examples": 3441}, {"name": "test", "num_bytes": 11150914, "num_examples": 3441}], "download_size": 42336357, "dataset_size": 110704758}, {"config_name": "wstp.mr", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 28302341, "num_examples": 10446}, {"name": "validation", "num_bytes": 3328798, "num_examples": 1306}, {"name": "test", "num_bytes": 3631684, "num_examples": 1306}], "download_size": 13886208, "dataset_size": 35262823}, {"config_name": "wstp.or", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 10900006, "num_examples": 4015}, {"name": "validation", "num_bytes": 1264935, "num_examples": 502}, {"name": "test", "num_bytes": 1344652, "num_examples": 502}], "download_size": 5319128, "dataset_size": 13509593}, {"config_name": "wstp.pa", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 22189730, "num_examples": 8772}, {"name": "validation", "num_bytes": 2789186, "num_examples": 1097}, {"name": "test", "num_bytes": 2685767, "num_examples": 1097}], "download_size": 11201369, "dataset_size": 27664683}, {"config_name": "wstp.ta", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 151929218, "num_examples": 48940}, {"name": "validation", "num_bytes": 18817167, "num_examples": 6117}, {"name": "test", "num_bytes": 18815071, "num_examples": 6118}], "download_size": 68699092, "dataset_size": 189561456}, {"config_name": "wstp.te", "features": [{"name": "sectionText", "dtype": "string"}, {"name": "correctTitle", "dtype": "string"}, {"name": "titleA", "dtype": "string"}, {"name": "titleB", "dtype": "string"}, {"name": "titleC", "dtype": "string"}, {"name": "titleD", "dtype": "string"}, {"name": "url", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 151696691, "num_examples": 80000}, {"name": "validation", "num_bytes": 19003169, "num_examples": 10000}, {"name": "test", "num_bytes": 18991913, "num_examples": 10000}], "download_size": 50158580, "dataset_size": 189691773}], "configs": [{"config_name": "actsa-sc.te", "data_files": [{"split": "train", "path": "actsa-sc.te/train-*"}, {"split": "validation", "path": "actsa-sc.te/validation-*"}, {"split": "test", "path": "actsa-sc.te/test-*"}]}, {"config_name": "bbca.hi", "data_files": [{"split": "train", "path": "bbca.hi/train-*"}, {"split": "test", "path": "bbca.hi/test-*"}]}, {"config_name": "copa.en", "data_files": [{"split": "train", "path": "copa.en/train-*"}, {"split": "validation", "path": "copa.en/validation-*"}, {"split": "test", "path": "copa.en/test-*"}]}, {"config_name": "copa.gu", "data_files": [{"split": "train", "path": "copa.gu/train-*"}, {"split": "validation", "path": "copa.gu/validation-*"}, {"split": "test", "path": "copa.gu/test-*"}]}, {"config_name": "copa.hi", "data_files": [{"split": "train", "path": "copa.hi/train-*"}, {"split": "validation", "path": "copa.hi/validation-*"}, {"split": "test", "path": "copa.hi/test-*"}]}, {"config_name": "copa.mr", "data_files": [{"split": "train", "path": "copa.mr/train-*"}, {"split": "validation", "path": "copa.mr/validation-*"}, {"split": "test", "path": "copa.mr/test-*"}]}, {"config_name": "csqa.as", "data_files": [{"split": "test", "path": "csqa.as/test-*"}]}, {"config_name": "csqa.bn", "data_files": [{"split": "test", "path": "csqa.bn/test-*"}]}, {"config_name": "csqa.gu", "data_files": [{"split": "test", "path": "csqa.gu/test-*"}]}, {"config_name": "csqa.hi", "data_files": [{"split": "test", "path": "csqa.hi/test-*"}]}, {"config_name": "csqa.kn", "data_files": [{"split": "test", "path": "csqa.kn/test-*"}]}, {"config_name": "csqa.ml", "data_files": [{"split": "test", "path": "csqa.ml/test-*"}]}, {"config_name": "csqa.mr", "data_files": [{"split": "test", "path": "csqa.mr/test-*"}]}, {"config_name": "csqa.or", "data_files": [{"split": "test", "path": "csqa.or/test-*"}]}, {"config_name": "csqa.pa", "data_files": [{"split": "test", "path": "csqa.pa/test-*"}]}, {"config_name": "csqa.ta", "data_files": [{"split": "test", "path": "csqa.ta/test-*"}]}, {"config_name": "csqa.te", "data_files": [{"split": "test", "path": "csqa.te/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-bn", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-bn/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-gu", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-gu/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-hi", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-hi/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-ml", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-ml/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-mr", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-mr/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-or", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-or/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-ta", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-ta/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-te", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-te/test-*"}]}, {"config_name": "cvit-mkb-clsr.en-ur", "data_files": [{"split": "test", "path": "cvit-mkb-clsr.en-ur/test-*"}]}, {"config_name": "iitp-mr.hi", "data_files": [{"split": "train", "path": "iitp-mr.hi/train-*"}, {"split": "validation", "path": "iitp-mr.hi/validation-*"}, {"split": "test", "path": "iitp-mr.hi/test-*"}]}, {"config_name": "iitp-pr.hi", "data_files": [{"split": "train", "path": "iitp-pr.hi/train-*"}, {"split": "validation", "path": "iitp-pr.hi/validation-*"}, {"split": "test", "path": "iitp-pr.hi/test-*"}]}, {"config_name": "inltkh.gu", "data_files": [{"split": "train", "path": "inltkh.gu/train-*"}, {"split": "validation", "path": "inltkh.gu/validation-*"}, {"split": "test", "path": "inltkh.gu/test-*"}]}, {"config_name": "inltkh.ml", "data_files": [{"split": "train", "path": "inltkh.ml/train-*"}, {"split": "validation", "path": "inltkh.ml/validation-*"}, {"split": "test", "path": "inltkh.ml/test-*"}]}, {"config_name": "inltkh.mr", "data_files": [{"split": "train", "path": "inltkh.mr/train-*"}, {"split": "validation", "path": "inltkh.mr/validation-*"}, {"split": "test", "path": "inltkh.mr/test-*"}]}, {"config_name": "inltkh.ta", "data_files": [{"split": "train", "path": "inltkh.ta/train-*"}, {"split": "validation", "path": "inltkh.ta/validation-*"}, {"split": "test", "path": "inltkh.ta/test-*"}]}, {"config_name": "inltkh.te", "data_files": [{"split": "train", "path": "inltkh.te/train-*"}, {"split": "validation", "path": "inltkh.te/validation-*"}, {"split": "test", "path": "inltkh.te/test-*"}]}, {"config_name": "md.hi", "data_files": [{"split": "train", "path": "md.hi/train-*"}, {"split": "validation", "path": "md.hi/validation-*"}, {"split": "test", "path": "md.hi/test-*"}]}, {"config_name": "sna.bn", "data_files": [{"split": "train", "path": "sna.bn/train-*"}, {"split": "validation", "path": "sna.bn/validation-*"}, {"split": "test", "path": "sna.bn/test-*"}]}, {"config_name": "wiki-ner.as", "data_files": [{"split": "train", "path": "wiki-ner.as/train-*"}, {"split": "validation", "path": "wiki-ner.as/validation-*"}, {"split": "test", "path": "wiki-ner.as/test-*"}]}, {"config_name": "wiki-ner.bn", "data_files": [{"split": "train", "path": "wiki-ner.bn/train-*"}, {"split": "validation", "path": "wiki-ner.bn/validation-*"}, {"split": "test", "path": "wiki-ner.bn/test-*"}]}, {"config_name": "wiki-ner.gu", "data_files": [{"split": "train", "path": "wiki-ner.gu/train-*"}, {"split": "validation", "path": "wiki-ner.gu/validation-*"}, {"split": "test", "path": "wiki-ner.gu/test-*"}]}, {"config_name": "wiki-ner.hi", "data_files": [{"split": "train", "path": "wiki-ner.hi/train-*"}, {"split": "validation", "path": "wiki-ner.hi/validation-*"}, {"split": "test", "path": "wiki-ner.hi/test-*"}]}, {"config_name": "wiki-ner.kn", "data_files": [{"split": "train", "path": "wiki-ner.kn/train-*"}, {"split": "validation", "path": "wiki-ner.kn/validation-*"}, {"split": "test", "path": "wiki-ner.kn/test-*"}]}, {"config_name": "wiki-ner.ml", "data_files": [{"split": "train", "path": "wiki-ner.ml/train-*"}, {"split": "validation", "path": "wiki-ner.ml/validation-*"}, {"split": "test", "path": "wiki-ner.ml/test-*"}]}, {"config_name": "wiki-ner.mr", "data_files": [{"split": "train", "path": "wiki-ner.mr/train-*"}, {"split": "validation", "path": "wiki-ner.mr/validation-*"}, {"split": "test", "path": "wiki-ner.mr/test-*"}]}, {"config_name": "wiki-ner.or", "data_files": [{"split": "train", "path": "wiki-ner.or/train-*"}, {"split": "validation", "path": "wiki-ner.or/validation-*"}, {"split": "test", "path": "wiki-ner.or/test-*"}]}, {"config_name": "wiki-ner.pa", "data_files": [{"split": "train", "path": "wiki-ner.pa/train-*"}, {"split": "validation", "path": "wiki-ner.pa/validation-*"}, {"split": "test", "path": "wiki-ner.pa/test-*"}]}, {"config_name": "wiki-ner.ta", "data_files": [{"split": "train", "path": "wiki-ner.ta/train-*"}, {"split": "validation", "path": "wiki-ner.ta/validation-*"}, {"split": "test", "path": "wiki-ner.ta/test-*"}]}, {"config_name": "wiki-ner.te", "data_files": [{"split": "train", "path": "wiki-ner.te/train-*"}, {"split": "validation", "path": "wiki-ner.te/validation-*"}, {"split": "test", "path": "wiki-ner.te/test-*"}]}, {"config_name": "wnli.en", "data_files": [{"split": "train", "path": "wnli.en/train-*"}, {"split": "validation", "path": "wnli.en/validation-*"}, {"split": "test", "path": "wnli.en/test-*"}]}, {"config_name": "wnli.gu", "data_files": [{"split": "train", "path": "wnli.gu/train-*"}, {"split": "validation", "path": "wnli.gu/validation-*"}, {"split": "test", "path": "wnli.gu/test-*"}]}, {"config_name": "wnli.hi", "data_files": [{"split": "train", "path": "wnli.hi/train-*"}, {"split": "validation", "path": "wnli.hi/validation-*"}, {"split": "test", "path": "wnli.hi/test-*"}]}, {"config_name": "wnli.mr", "data_files": [{"split": "train", "path": "wnli.mr/train-*"}, {"split": "validation", "path": "wnli.mr/validation-*"}, {"split": "test", "path": "wnli.mr/test-*"}]}, {"config_name": "wstp.as", "data_files": [{"split": "train", "path": "wstp.as/train-*"}, {"split": "validation", "path": "wstp.as/validation-*"}, {"split": "test", "path": "wstp.as/test-*"}]}, {"config_name": "wstp.bn", "data_files": [{"split": "train", "path": "wstp.bn/train-*"}, {"split": "validation", "path": "wstp.bn/validation-*"}, {"split": "test", "path": "wstp.bn/test-*"}]}, {"config_name": "wstp.gu", "data_files": [{"split": "train", "path": "wstp.gu/train-*"}, {"split": "validation", "path": "wstp.gu/validation-*"}, {"split": "test", "path": "wstp.gu/test-*"}]}, {"config_name": "wstp.hi", "data_files": [{"split": "train", "path": "wstp.hi/train-*"}, {"split": "validation", "path": "wstp.hi/validation-*"}, {"split": "test", "path": "wstp.hi/test-*"}]}, {"config_name": "wstp.kn", "data_files": [{"split": "train", "path": "wstp.kn/train-*"}, {"split": "validation", "path": "wstp.kn/validation-*"}, {"split": "test", "path": "wstp.kn/test-*"}]}, {"config_name": "wstp.ml", "data_files": [{"split": "train", "path": "wstp.ml/train-*"}, {"split": "validation", "path": "wstp.ml/validation-*"}, {"split": "test", "path": "wstp.ml/test-*"}]}, {"config_name": "wstp.mr", "data_files": [{"split": "train", "path": "wstp.mr/train-*"}, {"split": "validation", "path": "wstp.mr/validation-*"}, {"split": "test", "path": "wstp.mr/test-*"}]}, {"config_name": "wstp.or", "data_files": [{"split": "train", "path": "wstp.or/train-*"}, {"split": "validation", "path": "wstp.or/validation-*"}, {"split": "test", "path": "wstp.or/test-*"}]}, {"config_name": "wstp.pa", "data_files": [{"split": "train", "path": "wstp.pa/train-*"}, {"split": "validation", "path": "wstp.pa/validation-*"}, {"split": "test", "path": "wstp.pa/test-*"}]}, {"config_name": "wstp.ta", "data_files": [{"split": "train", "path": "wstp.ta/train-*"}, {"split": "validation", "path": "wstp.ta/validation-*"}, {"split": "test", "path": "wstp.ta/test-*"}]}, {"config_name": "wstp.te", "data_files": [{"split": "train", "path": "wstp.te/train-*"}, {"split": "validation", "path": "wstp.te/validation-*"}, {"split": "test", "path": "wstp.te/test-*"}]}]}
TAGS
#task_categories-text-classification #task_categories-token-classification #task_categories-multiple-choice #task_ids-topic-classification #task_ids-natural-language-inference #task_ids-sentiment-analysis #task_ids-semantic-similarity-scoring #task_ids-named-entity-recognition #task_ids-multiple-choice-qa #annotations_creators-other #language_creators-found #multilinguality-multilingual #size_categories-100K<n<1M #source_datasets-extended|other #language-Assamese #language-Bengali #language-English #language-Gujarati #language-Hindi #language-Kannada #language-Malayalam #language-Marathi #language-Oriya (macrolanguage) #language-Panjabi #language-Tamil #language-Telugu #license-other #discourse-mode-classification #paraphrase-identification #cross-lingual-similarity #headline-classification #region-us 

Dataset Card for "indic\_glue"
==============================


Table of Contents
-----------------


* Dataset Description
	+ Dataset Summary
	+ Supported Tasks and Leaderboards
	+ Languages
* Dataset Structure
	+ Data Instances
	+ Data Fields
	+ Data Splits
* Dataset Creation
	+ Curation Rationale
	+ Source Data
	+ Annotations
	+ Personal and Sensitive Information
* Considerations for Using the Data
	+ Social Impact of Dataset
	+ Discussion of Biases
	+ Other Known Limitations
* Additional Information
	+ Dataset Curators
	+ Licensing Information
	+ Citation Information
	+ Contributions


Dataset Description
-------------------


* Homepage: URL
* Repository:
* Paper: IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages
* Point of Contact:
* Size of downloaded dataset files: 3.51 GB
* Size of the generated dataset: 1.65 GB
* Total amount of disk used: 5.16 GB


### Dataset Summary


IndicGLUE is a natural language understanding benchmark for Indian languages. It contains a wide
variety of tasks and covers 11 major Indian languages - as, bn, gu, hi, kn, ml, mr, or, pa, ta, te.


The Winograd Schema Challenge (Levesque et al., 2011) is a reading comprehension task
in which a system must read a sentence with a pronoun and select the referent of that pronoun from
a list of choices. The examples are manually constructed to foil simple statistical methods: Each
one is contingent on contextual information provided by a single word or phrase in the sentence.
To convert the problem into sentence pair classification, we construct sentence pairs by replacing
the ambiguous pronoun with each possible referent. The task is to predict if the sentence with the
pronoun substituted is entailed by the original sentence. We use a small evaluation set consisting of
new examples derived from fiction books that was shared privately by the authors of the original
corpus. While the included training set is balanced between two classes, the test set is imbalanced
between them (65% not entailment). Also, due to a data quirk, the development set is adversarial:
hypotheses are sometimes shared between training and development examples, so if a model memorizes the
training examples, they will predict the wrong label on corresponding development set
example. As with QNLI, each example is evaluated separately, so there is not a systematic correspondence
between a model's score on this task and its score on the unconverted original task. We
call converted dataset WNLI (Winograd NLI). This dataset is translated and publicly released for 3
Indian languages by AI4Bharat.


### Supported Tasks and Leaderboards


### Languages


Dataset Structure
-----------------


### Data Instances


#### URL


* Size of downloaded dataset files: 0.38 MB
* Size of the generated dataset: 1.71 MB
* Total amount of disk used: 2.09 MB


An example of 'validation' looks as follows.


#### URL


* Size of downloaded dataset files: 5.77 MB
* Size of the generated dataset: 27.63 MB
* Total amount of disk used: 33.40 MB


An example of 'train' looks as follows.


#### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.12 MB
* Total amount of disk used: 0.87 MB


An example of 'validation' looks as follows.


#### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'train' looks as follows.


#### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'validation' looks as follows.


### Data Fields


The data fields are the same among all splits.


#### URL


* 'text': a 'string' feature.
* 'label': a classification label, with possible values including 'positive' (0), 'negative' (1).


#### URL


* 'label': a 'string' feature.
* 'text': a 'string' feature.


#### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature.


#### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature.


#### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature.


### Data Splits


#### URL



#### URL



#### URL



#### URL



#### URL



Dataset Creation
----------------


### Curation Rationale


### Source Data


#### Initial Data Collection and Normalization


#### Who are the source language producers?


### Annotations


#### Annotation process


#### Who are the annotators?


### Personal and Sensitive Information


Considerations for Using the Data
---------------------------------


### Social Impact of Dataset


### Discussion of Biases


### Other Known Limitations


Additional Information
----------------------


### Dataset Curators


### Licensing Information


### Contributions


Thanks to @sumanthd17 for adding this dataset.



### Dataset Summary


IndicGLUE is a natural language understanding benchmark for Indian languages. It contains a wide
variety of tasks and covers 11 major Indian languages - as, bn, gu, hi, kn, ml, mr, or, pa, ta, te.


The Winograd Schema Challenge (Levesque et al., 2011) is a reading comprehension task
in which a system must read a sentence with a pronoun and select the referent of that pronoun from
a list of choices. The examples are manually constructed to foil simple statistical methods: Each
one is contingent on contextual information provided by a single word or phrase in the sentence.
To convert the problem into sentence pair classification, we construct sentence pairs by replacing
the ambiguous pronoun with each possible referent. The task is to predict if the sentence with the
pronoun substituted is entailed by the original sentence. We use a small evaluation set consisting of
new examples derived from fiction books that was shared privately by the authors of the original
corpus. While the included training set is balanced between two classes, the test set is imbalanced
between them (65% not entailment). Also, due to a data quirk, the development set is adversarial:
hypotheses are sometimes shared between training and development examples, so if a model memorizes the
training examples, they will predict the wrong label on corresponding development set
example. As with QNLI, each example is evaluated separately, so there is not a systematic correspondence
between a model's score on this task and its score on the unconverted original task. We
call converted dataset WNLI (Winograd NLI). This dataset is translated and publicly released for 3
Indian languages by AI4Bharat. ### Supported Tasks and Leaderboards ### Languages


Dataset Structure
----------------- ### Data Instances #### URL


* Size of downloaded dataset files: 0.38 MB
* Size of the generated dataset: 1.71 MB
* Total amount of disk used: 2.09 MB


An example of 'validation' looks as follows. #### URL


* Size of downloaded dataset files: 5.77 MB
* Size of the generated dataset: 27.63 MB
* Total amount of disk used: 33.40 MB


An example of 'train' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.12 MB
* Total amount of disk used: 0.87 MB


An example of 'validation' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'train' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'validation' looks as follows. ### Data Fields


The data fields are the same among all splits. #### URL


* 'text': a 'string' feature.
* 'label': a classification label, with possible values including 'positive' (0), 'negative' (1). #### URL


* 'label': a 'string' feature.
* 'text': a 'string' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. ### Data Splits #### URL #### URL #### URL #### URL #### URL



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators ### Licensing Information ### Contributions


Thanks to @sumanthd17 for adding this dataset.
TAGS
#task_categories-text-classification #task_categories-token-classification #task_categories-multiple-choice #task_ids-topic-classification #task_ids-natural-language-inference #task_ids-sentiment-analysis #task_ids-semantic-similarity-scoring #task_ids-named-entity-recognition #task_ids-multiple-choice-qa #annotations_creators-other #language_creators-found #multilinguality-multilingual #size_categories-100K<n<1M #source_datasets-extended|other #language-Assamese #language-Bengali #language-English #language-Gujarati #language-Hindi #language-Kannada #language-Malayalam #language-Marathi #language-Oriya (macrolanguage) #language-Panjabi #language-Tamil #language-Telugu #license-other #discourse-mode-classification #paraphrase-identification #cross-lingual-similarity #headline-classification #region-us 
 ### Dataset Summary


IndicGLUE is a natural language understanding benchmark for Indian languages. It contains a wide
variety of tasks and covers 11 major Indian languages - as, bn, gu, hi, kn, ml, mr, or, pa, ta, te.


The Winograd Schema Challenge (Levesque et al., 2011) is a reading comprehension task
in which a system must read a sentence with a pronoun and select the referent of that pronoun from
a list of choices. The examples are manually constructed to foil simple statistical methods: Each
one is contingent on contextual information provided by a single word or phrase in the sentence.
To convert the problem into sentence pair classification, we construct sentence pairs by replacing
the ambiguous pronoun with each possible referent. The task is to predict if the sentence with the
pronoun substituted is entailed by the original sentence. We use a small evaluation set consisting of
new examples derived from fiction books that was shared privately by the authors of the original
corpus. While the included training set is balanced between two classes, the test set is imbalanced
between them (65% not entailment). Also, due to a data quirk, the development set is adversarial:
hypotheses are sometimes shared between training and development examples, so if a model memorizes the
training examples, they will predict the wrong label on corresponding development set
example. As with QNLI, each example is evaluated separately, so there is not a systematic correspondence
between a model's score on this task and its score on the unconverted original task. We
call converted dataset WNLI (Winograd NLI). This dataset is translated and publicly released for 3
Indian languages by AI4Bharat. ### Supported Tasks and Leaderboards ### Languages


Dataset Structure
----------------- ### Data Instances #### URL


* Size of downloaded dataset files: 0.38 MB
* Size of the generated dataset: 1.71 MB
* Total amount of disk used: 2.09 MB


An example of 'validation' looks as follows. #### URL


* Size of downloaded dataset files: 5.77 MB
* Size of the generated dataset: 27.63 MB
* Total amount of disk used: 33.40 MB


An example of 'train' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.12 MB
* Total amount of disk used: 0.87 MB


An example of 'validation' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'train' looks as follows. #### URL


* Size of downloaded dataset files: 0.75 MB
* Size of the generated dataset: 0.23 MB
* Total amount of disk used: 0.99 MB


An example of 'validation' looks as follows. ### Data Fields


The data fields are the same among all splits. #### URL


* 'text': a 'string' feature.
* 'label': a classification label, with possible values including 'positive' (0), 'negative' (1). #### URL


* 'label': a 'string' feature.
* 'text': a 'string' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. #### URL


* 'premise': a 'string' feature.
* 'choice1': a 'string' feature.
* 'choice2': a 'string' feature.
* 'question': a 'string' feature.
* 'label': a 'int32' feature. ### Data Splits #### URL #### URL #### URL #### URL #### URL



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators ### Licensing Information ### Contributions


Thanks to @sumanthd17 for adding this dataset.