# The Adversarial Natural Language Inference (ANLI)

- Source: https://huggingface.co/datasets/anli
- Num examples: 
  - 100,459 (train)
  - 1,200 (validation)
  - 1,200 (test)
- Language: English

```python
from datasets import load_dataset

load_dataset("vietgpt/anli_r3_en")
```

- Format for NLI task

```python
def preprocess(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    label = sample['label']

    if label == 0:
        label = "entailment"
    elif label == 1:
        label = "neutral"
    else:
        label = "contradiction"
    return {'text': f'<|startoftext|><|premise|> {premise} <|hypothesis|> {hypothesis} <|label|> {label} <|endoftext|>'}

"""
<|startoftext|><|premise|> TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|hypothesis|> The article was written on December 18th. <|label|> entailment <|endoftext|>
"""
```

- Format for Rationale task

```python
def preprocess_rationale(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    rationale = sample['reason']

    return {'text': f'<|startoftext|><|premise|> {premise} <|hypothesis|> {hypothesis} <|rationale|> {rationale} <|endoftext|>'}

"""
<|startoftext|><|premise|> TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|hypothesis|> The article was written on December 18th. <|rationale|> TOKYO, Dec 18 (Reuters) is when the article was written as it states in the first words of the sentence <|endoftext|>
"""
```

- Format for GPT-3

```python
def preprocess_gpt3(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    label = sample['label']

    if label == 0:
        output = f'\n<|correct|> True\n<|incorrect|> False\n<|incorrect|> Neither'
    elif label == 1:
        output = f'\n<|correct|> Neither\n<|incorrect|> True\n<|incorrect|> False'
    else:
        output = f'\n<|correct|> False\n<|incorrect|> True\n<|incorrect|> Neither'

    return {'text': f'<|startoftext|> anli 2: {premise} <|question|> {hypothesis}\nTrue, False, or Neither? <|answer|> {output} <|endoftext|>'}

"""
<|startoftext|> anli 2: TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|question|> The article was written on December 18th.
True, False, or Neither? <|answer|> 
<|correct|> True
<|incorrect|> False
<|incorrect|> Neither <|endoftext|>
"""
```
task_categories:text-classification size_categories:100K<n<1M language:en NLI region:us
{"language": ["en"], "size_categories": ["100K<n<1M"], "task_categories": ["text-classification"], "dataset_info": {"features": [{"name": "uid", "dtype": "string"}, {"name": "premise", "dtype": "string"}, {"name": "hypothesis", "dtype": "string"}, {"name": "label", "dtype": {"class_label": {"names": {"0": "entailment", "1": "neutral", "2": "contradiction"}}}}, {"name": "reason", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 44720719, "num_examples": 100459}, {"name": "validation", "num_bytes": 663148, "num_examples": 1200}, {"name": "test", "num_bytes": 657586, "num_examples": 1200}], "download_size": 15202058, "dataset_size": 46041453}, "tags": ["NLI"]}
TAGS
#task_categories-text-classification #size_categories-100K<n<1M #language-English #NLI #region-us 

# The Adversarial Natural Language Inference (ANLI)

- Source: URL
- Num examples: 
  - 100,459 (train)
  - 1,200 (validation)
  - 1,200 (test)
- Language: English



- Format for NLI task



- Format for Rationale task



- Format for GPT-3


# The Adversarial Natural Language Inference (ANLI)

- Source: URL
- Num examples: 
  - 100,459 (train)
  - 1,200 (validation)
  - 1,200 (test)
- Language: English



- Format for NLI task



- Format for Rationale task



- Format for GPT-3
TAGS
#task_categories-text-classification #size_categories-100K<n<1M #language-English #NLI #region-us 
 # The Adversarial Natural Language Inference (ANLI)

- Source: URL
- Num examples: 
  - 100,459 (train)
  - 1,200 (validation)
  - 1,200 (test)
- Language: English



- Format for NLI task



- Format for Rationale task



- Format for GPT-3