
# Dataset Card for AQuaMuSe
## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://github.com/google-research-datasets/aquamuse
- **Repository:** https://github.com/google-research-datasets/aquamuse
- **Paper:** https://arxiv.org/pdf/2010.12694.pdf
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary

AQuaMuSe is a novel scalable approach to automatically mine dual query based multi-document summarization datasets for extractive and abstractive summaries using question answering dataset (Google Natural Questions) and large document corpora (Common Crawl)

This dataset contains versions of automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in [AQuaMuSe paper](https://arxiv.org/pdf/2010.12694.pdf).
### Supported Tasks and Leaderboards

- **Abstractive** and **Extractive** query-based multi-document summarization
- Question Answering

### Languages

en : English

## Dataset Structure

### Data Instances

- `input_urls`: a `list` of `string` features. 
- `query`: a `string` feature.
- `target`: a `string` feature


Example: 

```
{
    'input_urls': ['https://boxofficebuz.com/person/19653-charles-michael-davis'],
     'query': 'who is the actor that plays marcel on the originals',
     'target': "In February 2013, it was announced that Davis was cast in a lead role on The CW's new show The 
Originals, a spinoff of The Vampire Diaries, centered on the Original Family as they move to New Orleans, where 
Davis' character (a vampire named Marcel) currently rules."
}
```

### Data Fields

 - `input_urls`: a `list` of `string` features. 
  - List of URLs to input documents pointing to  [Common Crawl](https://commoncrawl.org/2017/07/june-2017-crawl-archive-now-available)  to be summarized. 
  - Dependencies: Documents URLs references the  [Common Crawl June 2017 Archive](https://commoncrawl.org/2017/07/june-2017-crawl-archive-now-available).
  
 - `query`: a `string` feature.
  - Input query to be used as summarization context. This is  derived from  [Natural Questions](https://ai.google.com/research/NaturalQuestions/)  user queries.
  
 -  `target`: a `string` feature
  - Summarization target, derived from  [Natural Questions](https://ai.google.com/research/NaturalQuestions/)  long answers.
### Data Splits
 - This dataset has two high-level configurations `abstractive` and `extractive`
 - Each configuration has the data splits of `train`, `dev` and `test`
 - The original format of the data was in [TFrecords](https://www.tensorflow.org/tutorials/load_data/tfrecord), which has been parsed to the format as specified in [Data Instances](#data-instances)
 
## Dataset Creation

### Curation Rationale

The dataset is automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in [AQuaMuSe paper](https://arxiv.org/pdf/2010.12694.pdf).
### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

The dataset curator is [sayalikulkarni](https://github.com/google-research-datasets/aquamuse/commits?author=sayalikulkarni), who is the contributor for the official GitHub repository for this dataset and also one of the authors of this dataset’s paper. As the account handles of other authors are not available currently who were also part of the curation of this dataset, the authors of the paper are mentioned here as follows, Sayali Kulkarni, Sheide Chammas, Wan Zhu, Fei Sha, and Eugene Ie.

### Licensing Information

[More Information Needed]

### Citation Information

@misc{kulkarni2020aquamuse,
      title={AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization}, 
      author={Sayali Kulkarni and Sheide Chammas and Wan Zhu and Fei Sha and Eugene Ie},
      year={2020},
      eprint={2010.12694},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

### Contributions

Thanks to [@Karthik-Bhaskar](https://github.com/Karthik-Bhaskar) for adding this dataset.
task_categories:other task_categories:question-answering task_categories:text2text-generation task_ids:abstractive-qa task_ids:extractive-qa annotations_creators:crowdsourced annotations_creators:expert-generated language_creators:crowdsourced language_creators:expert-generated multilinguality:monolingual size_categories:1K<n<10K source_datasets:extended|natural_questions source_datasets:extended|other-Common-Crawl source_datasets:original language:en license:unknown query-based-multi-document-summarization arxiv:2010.12694 region:us
{"annotations_creators": ["crowdsourced", "expert-generated"], "language_creators": ["crowdsourced", "expert-generated"], "language": ["en"], "license": ["unknown"], "multilinguality": ["monolingual"], "size_categories": ["1K<n<10K"], "source_datasets": ["extended|natural_questions", "extended|other-Common-Crawl", "original"], "task_categories": ["other", "question-answering", "text2text-generation"], "task_ids": ["abstractive-qa", "extractive-qa"], "paperswithcode_id": "aquamuse", "pretty_name": "AQuaMuSe", "tags": ["query-based-multi-document-summarization"], "dataset_info": [{"config_name": "abstractive", "features": [{"name": "query", "dtype": "string"}, {"name": "input_urls", "sequence": "string"}, {"name": "target", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 6434893, "num_examples": 6253}, {"name": "test", "num_bytes": 843165, "num_examples": 811}, {"name": "validation", "num_bytes": 689093, "num_examples": 661}], "download_size": 5167854, "dataset_size": 7967151}, {"config_name": "extractive", "features": [{"name": "query", "dtype": "string"}, {"name": "input_urls", "sequence": "string"}, {"name": "target", "dtype": "string"}], "splits": [{"name": "train", "num_bytes": 6434893, "num_examples": 6253}, {"name": "test", "num_bytes": 843165, "num_examples": 811}, {"name": "validation", "num_bytes": 689093, "num_examples": 661}], "download_size": 5162151, "dataset_size": 7967151}], "configs": [{"config_name": "abstractive", "data_files": [{"split": "train", "path": "abstractive/train-*"}, {"split": "test", "path": "abstractive/test-*"}, {"split": "validation", "path": "abstractive/validation-*"}]}, {"config_name": "extractive", "data_files": [{"split": "train", "path": "extractive/train-*"}, {"split": "test", "path": "extractive/test-*"}, {"split": "validation", "path": "extractive/validation-*"}]}]}
TAGS
#task_categories-other #task_categories-question-answering #task_categories-text2text-generation #task_ids-abstractive-qa #task_ids-extractive-qa #annotations_creators-crowdsourced #annotations_creators-expert-generated #language_creators-crowdsourced #language_creators-expert-generated #multilinguality-monolingual #size_categories-1K<n<10K #source_datasets-extended|natural_questions #source_datasets-extended|other-Common-Crawl #source_datasets-original #language-English #license-unknown #query-based-multi-document-summarization #arxiv-2010.12694 #region-us 


# Dataset Card for AQuaMuSe
## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions

## Dataset Description

- Homepage: URL
- Repository: URL
- Paper: URL
- Leaderboard:
- Point of Contact:

### Dataset Summary

AQuaMuSe is a novel scalable approach to automatically mine dual query based multi-document summarization datasets for extractive and abstractive summaries using question answering dataset (Google Natural Questions) and large document corpora (Common Crawl)

This dataset contains versions of automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper.
### Supported Tasks and Leaderboards

- Abstractive and Extractive query-based multi-document summarization
- Question Answering

### Languages

en : English

## Dataset Structure

### Data Instances

- 'input_urls': a 'list' of 'string' features. 
- 'query': a 'string' feature.
- 'target': a 'string' feature


Example: 



### Data Fields

 - 'input_urls': a 'list' of 'string' features. 
  - List of URLs to input documents pointing to  Common Crawl  to be summarized. 
  - Dependencies: Documents URLs references the  Common Crawl June 2017 Archive.
  
 - 'query': a 'string' feature.
  - Input query to be used as summarization context. This is  derived from  Natural Questions  user queries.
  
 -  'target': a 'string' feature
  - Summarization target, derived from  Natural Questions  long answers.
### Data Splits
 - This dataset has two high-level configurations 'abstractive' and 'extractive'
 - Each configuration has the data splits of 'train', 'dev' and 'test'
 - The original format of the data was in TFrecords, which has been parsed to the format as specified in Data Instances
 
## Dataset Creation

### Curation Rationale

The dataset is automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper.
### Source Data

#### Initial Data Collection and Normalization



#### Who are the source language producers?



### Annotations

#### Annotation process



#### Who are the annotators?



### Personal and Sensitive Information



## Considerations for Using the Data

### Social Impact of Dataset



### Discussion of Biases



### Other Known Limitations



## Additional Information

### Dataset Curators

The dataset curator is sayalikulkarni, who is the contributor for the official GitHub repository for this dataset and also one of the authors of this dataset’s paper. As the account handles of other authors are not available currently who were also part of the curation of this dataset, the authors of the paper are mentioned here as follows, Sayali Kulkarni, Sheide Chammas, Wan Zhu, Fei Sha, and Eugene Ie.

### Licensing Information





@misc{kulkarni2020aquamuse,
      title={AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization}, 
      author={Sayali Kulkarni and Sheide Chammas and Wan Zhu and Fei Sha and Eugene Ie},
      year={2020},
      eprint={2010.12694},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

### Contributions

Thanks to @Karthik-Bhaskar for adding this dataset.
# Dataset Card for AQuaMuSe ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions ## Dataset Description

- Homepage: URL
- Repository: URL
- Paper: URL
- Leaderboard:
- Point of Contact: ### Dataset Summary

AQuaMuSe is a novel scalable approach to automatically mine dual query based multi-document summarization datasets for extractive and abstractive summaries using question answering dataset (Google Natural Questions) and large document corpora (Common Crawl)

This dataset contains versions of automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper. ### Supported Tasks and Leaderboards

- Abstractive and Extractive query-based multi-document summarization
- Question Answering ### Languages

en : English ## Dataset Structure ### Data Instances

- 'input_urls': a 'list' of 'string' features. 
- 'query': a 'string' feature.
- 'target': a 'string' feature


Example: ### Data Fields

 - 'input_urls': a 'list' of 'string' features. 
  - List of URLs to input documents pointing to  Common Crawl  to be summarized. 
  - Dependencies: Documents URLs references the  Common Crawl June 2017 Archive.
  
 - 'query': a 'string' feature.
  - Input query to be used as summarization context. This is  derived from  Natural Questions  user queries.
  
 -  'target': a 'string' feature
  - Summarization target, derived from  Natural Questions  long answers. ### Data Splits
 - This dataset has two high-level configurations 'abstractive' and 'extractive'
 - Each configuration has the data splits of 'train', 'dev' and 'test'
 - The original format of the data was in TFrecords, which has been parsed to the format as specified in Data Instances ## Dataset Creation ### Curation Rationale

The dataset is automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper. ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators

The dataset curator is sayalikulkarni, who is the contributor for the official GitHub repository for this dataset and also one of the authors of this dataset’s paper. As the account handles of other authors are not available currently who were also part of the curation of this dataset, the authors of the paper are mentioned here as follows, Sayali Kulkarni, Sheide Chammas, Wan Zhu, Fei Sha, and Eugene Ie. ### Licensing Information





@misc{kulkarni2020aquamuse,
      title={AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization}, 
      author={Sayali Kulkarni and Sheide Chammas and Wan Zhu and Fei Sha and Eugene Ie},
      year={2020},
      eprint={2010.12694},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
} ### Contributions

Thanks to @Karthik-Bhaskar for adding this dataset.
TAGS
#task_categories-other #task_categories-question-answering #task_categories-text2text-generation #task_ids-abstractive-qa #task_ids-extractive-qa #annotations_creators-crowdsourced #annotations_creators-expert-generated #language_creators-crowdsourced #language_creators-expert-generated #multilinguality-monolingual #size_categories-1K<n<10K #source_datasets-extended|natural_questions #source_datasets-extended|other-Common-Crawl #source_datasets-original #language-English #license-unknown #query-based-multi-document-summarization #arxiv-2010.12694 #region-us 
 # Dataset Card for AQuaMuSe ## Table of Contents
- Dataset Description
  - Dataset Summary
  - Supported Tasks and Leaderboards
  - Languages
- Dataset Structure
  - Data Instances
  - Data Fields
  - Data Splits
- Dataset Creation
  - Curation Rationale
  - Source Data
  - Annotations
  - Personal and Sensitive Information
- Considerations for Using the Data
  - Social Impact of Dataset
  - Discussion of Biases
  - Other Known Limitations
- Additional Information
  - Dataset Curators
  - Licensing Information
  - Citation Information
  - Contributions ## Dataset Description

- Homepage: URL
- Repository: URL
- Paper: URL
- Leaderboard:
- Point of Contact: ### Dataset Summary

AQuaMuSe is a novel scalable approach to automatically mine dual query based multi-document summarization datasets for extractive and abstractive summaries using question answering dataset (Google Natural Questions) and large document corpora (Common Crawl)

This dataset contains versions of automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper. ### Supported Tasks and Leaderboards

- Abstractive and Extractive query-based multi-document summarization
- Question Answering ### Languages

en : English ## Dataset Structure ### Data Instances

- 'input_urls': a 'list' of 'string' features. 
- 'query': a 'string' feature.
- 'target': a 'string' feature


Example: ### Data Fields

 - 'input_urls': a 'list' of 'string' features. 
  - List of URLs to input documents pointing to  Common Crawl  to be summarized. 
  - Dependencies: Documents URLs references the  Common Crawl June 2017 Archive.
  
 - 'query': a 'string' feature.
  - Input query to be used as summarization context. This is  derived from  Natural Questions  user queries.
  
 -  'target': a 'string' feature
  - Summarization target, derived from  Natural Questions  long answers. ### Data Splits
 - This dataset has two high-level configurations 'abstractive' and 'extractive'
 - Each configuration has the data splits of 'train', 'dev' and 'test'
 - The original format of the data was in TFrecords, which has been parsed to the format as specified in Data Instances ## Dataset Creation ### Curation Rationale

The dataset is automatically generated datasets for abstractive and extractive query-based multi-document summarization as described in AQuaMuSe paper. ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations ## Additional Information ### Dataset Curators

The dataset curator is sayalikulkarni, who is the contributor for the official GitHub repository for this dataset and also one of the authors of this dataset’s paper. As the account handles of other authors are not available currently who were also part of the curation of this dataset, the authors of the paper are mentioned here as follows, Sayali Kulkarni, Sheide Chammas, Wan Zhu, Fei Sha, and Eugene Ie. ### Licensing Information





@misc{kulkarni2020aquamuse,
      title={AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization}, 
      author={Sayali Kulkarni and Sheide Chammas and Wan Zhu and Fei Sha and Eugene Ie},
      year={2020},
      eprint={2010.12694},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
} ### Contributions

Thanks to @Karthik-Bhaskar for adding this dataset.