
# Dataset Card for "scan"

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** [https://github.com/brendenlake/SCAN](https://github.com/brendenlake/SCAN)
- **Repository:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Paper:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Size of downloaded dataset files:** 224.18 MB
- **Size of the generated dataset:** 44.53 MB
- **Total amount of disk used:** 268.71 MB

### Dataset Summary

SCAN tasks with various splits.

SCAN is a set of simple language-driven navigation tasks for studying
compositional learning and zero-shot generalization.

See https://github.com/brendenlake/SCAN for a description of the splits.

Example usage:
data = datasets.load_dataset('scan/length')

### Supported Tasks and Leaderboards

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Languages

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Dataset Structure

### Data Instances

#### addprim_jump

- **Size of downloaded dataset files:** 18.69 MB
- **Size of the generated dataset:** 4.05 MB
- **Total amount of disk used:** 22.73 MB

An example of 'train' looks as follows.
```

```

#### addprim_turn_left

- **Size of downloaded dataset files:** 18.69 MB
- **Size of the generated dataset:** 4.09 MB
- **Total amount of disk used:** 22.76 MB

An example of 'train' looks as follows.
```

```

#### filler_num0

- **Size of downloaded dataset files:** 18.69 MB
- **Size of the generated dataset:** 2.85 MB
- **Total amount of disk used:** 21.53 MB

An example of 'train' looks as follows.
```

```

#### filler_num1

- **Size of downloaded dataset files:** 18.69 MB
- **Size of the generated dataset:** 3.14 MB
- **Total amount of disk used:** 21.82 MB

An example of 'train' looks as follows.
```

```

#### filler_num2

- **Size of downloaded dataset files:** 18.69 MB
- **Size of the generated dataset:** 3.44 MB
- **Total amount of disk used:** 22.12 MB

An example of 'train' looks as follows.
```

```

### Data Fields

The data fields are the same among all splits.

#### addprim_jump
- `commands`: a `string` feature.
- `actions`: a `string` feature.

#### addprim_turn_left
- `commands`: a `string` feature.
- `actions`: a `string` feature.

#### filler_num0
- `commands`: a `string` feature.
- `actions`: a `string` feature.

#### filler_num1
- `commands`: a `string` feature.
- `actions`: a `string` feature.

#### filler_num2
- `commands`: a `string` feature.
- `actions`: a `string` feature.

### Data Splits

|      name       |train|test|
|-----------------|----:|---:|
|addprim_jump     |14670|7706|
|addprim_turn_left|21890|1208|
|filler_num0      |15225|1173|
|filler_num1      |16290|1173|
|filler_num2      |17391|1173|

## Dataset Creation

### Curation Rationale

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the source language producers?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Annotations

#### Annotation process

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the annotators?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Personal and Sensitive Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Discussion of Biases

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Other Known Limitations

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Additional Information

### Dataset Curators

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Licensing Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Citation Information

```
@inproceedings{Lake2018GeneralizationWS,
  title={Generalization without Systematicity: On the Compositional Skills of
         Sequence-to-Sequence Recurrent Networks},
  author={Brenden M. Lake and Marco Baroni},
  booktitle={ICML},
  year={2018},
  url={https://arxiv.org/pdf/1711.00350.pdf},
}
```


### Contributions

Thanks to [@lewtun](https://github.com/lewtun), [@patrickvonplaten](https://github.com/patrickvonplaten), [@mariamabarham](https://github.com/mariamabarham), [@thomwolf](https://github.com/thomwolf) for adding this dataset.
task_categories:text2text-generation annotations_creators:no-annotation language_creators:expert-generated multilinguality:monolingual size_categories:10K<n<100K source_datasets:original language:en license:bsd multi-turn arxiv:1711.00350 region:us
{"annotations_creators": ["no-annotation"], "language_creators": ["expert-generated"], "language": ["en"], "license": ["bsd"], "multilinguality": ["monolingual"], "size_categories": ["10K<n<100K"], "source_datasets": ["original"], "task_categories": ["text2text-generation"], "task_ids": [], "paperswithcode_id": "scan", "pretty_name": "SCAN", "config_names": ["addprim_jump", "addprim_turn_left", "filler_num0", "filler_num1", "filler_num2", "filler_num3", "length", "simple", "template_around_right", "template_jump_around_right", "template_opposite_right", "template_right"], "tags": ["multi-turn"], "dataset_info": [{"config_name": "simple", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3217770, "num_examples": 16728}, {"name": "test", "num_bytes": 799912, "num_examples": 4182}], "download_size": 4080388, "dataset_size": 4017682}, {"config_name": "addprim_jump", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2535625, "num_examples": 14670}, {"name": "test", "num_bytes": 1508445, "num_examples": 7706}], "download_size": 4111174, "dataset_size": 4044070}, {"config_name": "addprim_turn_left", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3908891, "num_examples": 21890}, {"name": "test", "num_bytes": 170063, "num_examples": 1208}], "download_size": 4148216, "dataset_size": 4078954}, {"config_name": "filler_num0", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2513034, "num_examples": 15225}, {"name": "test", "num_bytes": 330087, "num_examples": 1173}], "download_size": 2892291, "dataset_size": 2843121}, {"config_name": "filler_num1", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2802865, "num_examples": 16290}, {"name": "test", "num_bytes": 330087, "num_examples": 1173}], "download_size": 3185317, "dataset_size": 3132952}, {"config_name": "filler_num2", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3106220, "num_examples": 17391}, {"name": "test", "num_bytes": 330087, "num_examples": 1173}], "download_size": 3491975, "dataset_size": 3436307}, {"config_name": "filler_num3", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3412704, "num_examples": 18528}, {"name": "test", "num_bytes": 330087, "num_examples": 1173}], "download_size": 3801870, "dataset_size": 3742791}, {"config_name": "length", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2672464, "num_examples": 16990}, {"name": "test", "num_bytes": 1345218, "num_examples": 3920}], "download_size": 4080388, "dataset_size": 4017682}, {"config_name": "template_around_right", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2513034, "num_examples": 15225}, {"name": "test", "num_bytes": 1229757, "num_examples": 4476}], "download_size": 3801870, "dataset_size": 3742791}, {"config_name": "template_jump_around_right", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3412704, "num_examples": 18528}, {"name": "test", "num_bytes": 330087, "num_examples": 1173}], "download_size": 3801870, "dataset_size": 3742791}, {"config_name": "template_opposite_right", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 2944398, "num_examples": 15225}, {"name": "test", "num_bytes": 857943, "num_examples": 4476}], "download_size": 3861420, "dataset_size": 3802341}, {"config_name": "template_right", "features": [{"name": "commands", "dtype": "string"}, {"name": "actions", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 3127623, "num_examples": 15225}, {"name": "test", "num_bytes": 716403, "num_examples": 4476}], "download_size": 3903105, "dataset_size": 3844026}]}
TAGS
#task_categories-text2text-generation #annotations_creators-no-annotation #language_creators-expert-generated #multilinguality-monolingual #size_categories-10K<n<100K #source_datasets-original #language-English #license-bsd #multi-turn #arxiv-1711.00350 #region-us 

Dataset Card for "scan"
=======================


Table of Contents
-----------------


* Dataset Description
	+ Dataset Summary
	+ Supported Tasks and Leaderboards
	+ Languages
* Dataset Structure
	+ Data Instances
	+ Data Fields
	+ Data Splits
* Dataset Creation
	+ Curation Rationale
	+ Source Data
	+ Annotations
	+ Personal and Sensitive Information
* Considerations for Using the Data
	+ Social Impact of Dataset
	+ Discussion of Biases
	+ Other Known Limitations
* Additional Information
	+ Dataset Curators
	+ Licensing Information
	+ Citation Information
	+ Contributions


Dataset Description
-------------------


* Homepage: URL
* Repository:
* Paper:
* Point of Contact:
* Size of downloaded dataset files: 224.18 MB
* Size of the generated dataset: 44.53 MB
* Total amount of disk used: 268.71 MB


### Dataset Summary


SCAN tasks with various splits.


SCAN is a set of simple language-driven navigation tasks for studying
compositional learning and zero-shot generalization.


See URL for a description of the splits.


Example usage:
data = datasets.load\_dataset('scan/length')


### Supported Tasks and Leaderboards


### Languages


Dataset Structure
-----------------


### Data Instances


#### addprim\_jump


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.05 MB
* Total amount of disk used: 22.73 MB


An example of 'train' looks as follows.


#### addprim\_turn\_left


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.09 MB
* Total amount of disk used: 22.76 MB


An example of 'train' looks as follows.


#### filler\_num0


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 2.85 MB
* Total amount of disk used: 21.53 MB


An example of 'train' looks as follows.


#### filler\_num1


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.14 MB
* Total amount of disk used: 21.82 MB


An example of 'train' looks as follows.


#### filler\_num2


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.44 MB
* Total amount of disk used: 22.12 MB


An example of 'train' looks as follows.


### Data Fields


The data fields are the same among all splits.


#### addprim\_jump


* 'commands': a 'string' feature.
* 'actions': a 'string' feature.


#### addprim\_turn\_left


* 'commands': a 'string' feature.
* 'actions': a 'string' feature.


#### filler\_num0


* 'commands': a 'string' feature.
* 'actions': a 'string' feature.


#### filler\_num1


* 'commands': a 'string' feature.
* 'actions': a 'string' feature.


#### filler\_num2


* 'commands': a 'string' feature.
* 'actions': a 'string' feature.


### Data Splits



Dataset Creation
----------------


### Curation Rationale


### Source Data


#### Initial Data Collection and Normalization


#### Who are the source language producers?


### Annotations


#### Annotation process


#### Who are the annotators?


### Personal and Sensitive Information


Considerations for Using the Data
---------------------------------


### Social Impact of Dataset


### Discussion of Biases


### Other Known Limitations


Additional Information
----------------------


### Dataset Curators


### Licensing Information


### Contributions


Thanks to @lewtun, @patrickvonplaten, @mariamabarham, @thomwolf for adding this dataset.



### Dataset Summary


SCAN tasks with various splits.


SCAN is a set of simple language-driven navigation tasks for studying
compositional learning and zero-shot generalization.


See URL for a description of the splits.


Example usage:
data = datasets.load\_dataset('scan/length') ### Supported Tasks and Leaderboards ### Languages


Dataset Structure
----------------- ### Data Instances #### addprim\_jump


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.05 MB
* Total amount of disk used: 22.73 MB


An example of 'train' looks as follows. #### addprim\_turn\_left


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.09 MB
* Total amount of disk used: 22.76 MB


An example of 'train' looks as follows. #### filler\_num0


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 2.85 MB
* Total amount of disk used: 21.53 MB


An example of 'train' looks as follows. #### filler\_num1


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.14 MB
* Total amount of disk used: 21.82 MB


An example of 'train' looks as follows. #### filler\_num2


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.44 MB
* Total amount of disk used: 22.12 MB


An example of 'train' looks as follows. ### Data Fields


The data fields are the same among all splits. #### addprim\_jump


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### addprim\_turn\_left


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num0


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num1


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num2


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. ### Data Splits



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators ### Licensing Information ### Contributions


Thanks to @lewtun, @patrickvonplaten, @mariamabarham, @thomwolf for adding this dataset.
TAGS
#task_categories-text2text-generation #annotations_creators-no-annotation #language_creators-expert-generated #multilinguality-monolingual #size_categories-10K<n<100K #source_datasets-original #language-English #license-bsd #multi-turn #arxiv-1711.00350 #region-us 
 ### Dataset Summary


SCAN tasks with various splits.


SCAN is a set of simple language-driven navigation tasks for studying
compositional learning and zero-shot generalization.


See URL for a description of the splits.


Example usage:
data = datasets.load\_dataset('scan/length') ### Supported Tasks and Leaderboards ### Languages


Dataset Structure
----------------- ### Data Instances #### addprim\_jump


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.05 MB
* Total amount of disk used: 22.73 MB


An example of 'train' looks as follows. #### addprim\_turn\_left


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 4.09 MB
* Total amount of disk used: 22.76 MB


An example of 'train' looks as follows. #### filler\_num0


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 2.85 MB
* Total amount of disk used: 21.53 MB


An example of 'train' looks as follows. #### filler\_num1


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.14 MB
* Total amount of disk used: 21.82 MB


An example of 'train' looks as follows. #### filler\_num2


* Size of downloaded dataset files: 18.69 MB
* Size of the generated dataset: 3.44 MB
* Total amount of disk used: 22.12 MB


An example of 'train' looks as follows. ### Data Fields


The data fields are the same among all splits. #### addprim\_jump


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### addprim\_turn\_left


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num0


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num1


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. #### filler\_num2


* 'commands': a 'string' feature.
* 'actions': a 'string' feature. ### Data Splits



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators ### Licensing Information ### Contributions


Thanks to @lewtun, @patrickvonplaten, @mariamabarham, @thomwolf for adding this dataset.