
# Dataset Card for SOTAB

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-instances)
  - [Data Splits](#data-instances)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)

## Dataset Description

- **Homepage:** [SOTAB homepage](https://webdatacommons.org/structureddata/sotab/)
- **Repository:** [SOTAB repository](https://github.com/wbsg-uni-mannheim/wdc-sotab)
- **Paper:** [SOTAB: The WDC Schema.org Table Annotation Benchmark](https://ceur-ws.org/Vol-3320/paper1.pdf)
- **Leaderboard:** [SOTAB leaderboard on PaperWithCode](https://paperswithcode.com/paper/sotab-the-wdc-schema-org-table-annotation)
- **Point of Contact:** [Needs More Information]

### Dataset Summary

The SOTAB dataset is a large-scale dataset for the task of column type annotation on semi-structured tables.

### Supported Tasks and Leaderboards

table-annotation, column-type-annotation

### Languages

en

## Dataset Structure

### Data Instances

#### default

- **Size of downloaded dataset files:** 
- **Size of the generated dataset:** 
- **Total amount of disk used:** 

An example of 'validation' looks as follows:
```
{
    "id": 0,
    "column_index": 3,
    "label": "currency",
    "table": {
        "name": "Book_7sat.co.uk_September2020_CTA.json.gz",
        "header": ["col1", "col2", ...]
        "rows": [
           ["2001", "2", "USL A-League", ...],
           ["2002", "2", "USL A-League", ...], 
           ...
        ]
    }
}
```

### Data Fields

The data fields are the same among all splits.

#### default
- `id`: a `int32` feature.
- `column_index`: a `string` feature.
- `label`: a `string` feature.
- `table`: a dictionary feature containing:
  - `rows`: a `list` of `string` features.
  - `rows`: a `list` of `list` of `string` features.
  - `name`: a `string` feature.

### Data Splits

| name  |train|validation|test |
|-------|-----:|---------:|----:|
|default|130471|     16840|15040|

## Dataset Creation

### Curation Rationale

[Needs More Information]

### Source Data

#### Initial Data Collection and Normalization

[Needs More Information]

#### Who are the source language producers?

[Needs More Information]

### Annotations

#### Annotation process

[Needs More Information]

#### Who are the annotators?

[Needs More Information]

### Personal and Sensitive Information

[Needs More Information]

## Considerations for Using the Data

### Social Impact of Dataset

[Needs More Information]

### Discussion of Biases

[Needs More Information]

### Other Known Limitations

[Needs More Information]

## Additional Information

### Dataset Curators

Panupong Pasupat and Percy Liang

### Licensing Information

Creative Commons Attribution Share Alike 4.0 International

### Citation Information

```

```

### Contributions

Thanks to [@ShivangiBithel](https://github.com/shivangibithel) for adding this dataset.
annotations_creators:crowdsourced language_creators:found multilinguality:monolingual source_datasets:original language:en license:cc-by-4.0 table-annotation region:us
{"annotations_creators": ["crowdsourced"], "language_creators": ["found"], "language": ["en"], "license": ["cc-by-4.0"], "multilinguality": ["monolingual"], "source_datasets": ["original"], "task_ids": [], "pretty_name": "SOTAB_CTA", "tags": ["table-annotation"], "dataset_info": [{"features": [{"name": "column_index", "dtype": "int32"}, {"name": "label", "dtype": "string"}, {"name": "table", "struct": [{"name": "header", "sequence": "string"}, {"name": "rows", "sequence": {"sequence": "string"}}, {"name": "name", "dtype": "string"}]}], "splits": [{"name": "train", "num_examples": 130471}, {"name": "test", "num_examples": 15040}, {"name": "validation", "num_examples": 16840}], "dataset_size": 162351}]}
TAGS
#annotations_creators-crowdsourced #language_creators-found #multilinguality-monolingual #source_datasets-original #language-English #license-cc-by-4.0 #table-annotation #region-us 

Dataset Card for SOTAB
======================


Table of Contents
-----------------


* Dataset Description
	+ Dataset Summary
	+ Supported Tasks
	+ Languages
* Dataset Structure
	+ Data Instances
	+ Data Fields
	+ Data Splits
* Dataset Creation
	+ Curation Rationale
	+ Source Data
	+ Annotations
	+ Personal and Sensitive Information
* Considerations for Using the Data
	+ Social Impact of Dataset
	+ Discussion of Biases
	+ Other Known Limitations
* Additional Information
	+ Dataset Curators
	+ Licensing Information
	+ Citation Information


Dataset Description
-------------------


* Homepage: SOTAB homepage
* Repository: SOTAB repository
* Paper: SOTAB: The WDC URL Table Annotation Benchmark
* Leaderboard: SOTAB leaderboard on PaperWithCode
* Point of Contact:


### Dataset Summary


The SOTAB dataset is a large-scale dataset for the task of column type annotation on semi-structured tables.


### Supported Tasks and Leaderboards


table-annotation, column-type-annotation


### Languages


en


Dataset Structure
-----------------


### Data Instances


#### default


* Size of downloaded dataset files:
* Size of the generated dataset:
* Total amount of disk used:


An example of 'validation' looks as follows:


### Data Fields


The data fields are the same among all splits.


#### default


* 'id': a 'int32' feature.
* 'column\_index': a 'string' feature.
* 'label': a 'string' feature.
* 'table': a dictionary feature containing:
	+ 'rows': a 'list' of 'string' features.
	+ 'rows': a 'list' of 'list' of 'string' features.
	+ 'name': a 'string' feature.


### Data Splits



Dataset Creation
----------------


### Curation Rationale


### Source Data


#### Initial Data Collection and Normalization


#### Who are the source language producers?


### Annotations


#### Annotation process


#### Who are the annotators?


### Personal and Sensitive Information


Considerations for Using the Data
---------------------------------


### Social Impact of Dataset


### Discussion of Biases


### Other Known Limitations


Additional Information
----------------------


### Dataset Curators


Panupong Pasupat and Percy Liang


### Licensing Information


Creative Commons Attribution Share Alike 4.0 International


### Contributions


Thanks to @ShivangiBithel for adding this dataset.



### Dataset Summary


The SOTAB dataset is a large-scale dataset for the task of column type annotation on semi-structured tables. ### Supported Tasks and Leaderboards


table-annotation, column-type-annotation ### Languages


en


Dataset Structure
----------------- ### Data Instances #### default


* Size of downloaded dataset files:
* Size of the generated dataset:
* Total amount of disk used:


An example of 'validation' looks as follows: ### Data Fields


The data fields are the same among all splits. #### default


* 'id': a 'int32' feature.
* 'column\_index': a 'string' feature.
* 'label': a 'string' feature.
* 'table': a dictionary feature containing:
	+ 'rows': a 'list' of 'string' features.
	+ 'rows': a 'list' of 'list' of 'string' features.
	+ 'name': a 'string' feature. ### Data Splits



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


Panupong Pasupat and Percy Liang ### Licensing Information


Creative Commons Attribution Share Alike 4.0 International ### Contributions


Thanks to @ShivangiBithel for adding this dataset.
TAGS
#annotations_creators-crowdsourced #language_creators-found #multilinguality-monolingual #source_datasets-original #language-English #license-cc-by-4.0 #table-annotation #region-us 
 ### Dataset Summary


The SOTAB dataset is a large-scale dataset for the task of column type annotation on semi-structured tables. ### Supported Tasks and Leaderboards


table-annotation, column-type-annotation ### Languages


en


Dataset Structure
----------------- ### Data Instances #### default


* Size of downloaded dataset files:
* Size of the generated dataset:
* Total amount of disk used:


An example of 'validation' looks as follows: ### Data Fields


The data fields are the same among all splits. #### default


* 'id': a 'int32' feature.
* 'column\_index': a 'string' feature.
* 'label': a 'string' feature.
* 'table': a dictionary feature containing:
	+ 'rows': a 'list' of 'string' features.
	+ 'rows': a 'list' of 'list' of 'string' features.
	+ 'name': a 'string' feature. ### Data Splits



Dataset Creation
---------------- ### Curation Rationale ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


Panupong Pasupat and Percy Liang ### Licensing Information


Creative Commons Attribution Share Alike 4.0 International ### Contributions


Thanks to @ShivangiBithel for adding this dataset.