
# Dataset Card for CSL

## Dataset Description

CSL is the Chinese Scientific Literature Dataset.

- **Paper:** https://aclanthology.org/2022.coling-1.344
- **Repository:** https://github.com/ydli-ai/CSL

### Dataset Summary

The dataset contains titles, abstracts, keywords of papers written in Chinese from several academic fields.

### Languages

 - Chinese
 - English (translation)

## Dataset Structure

### Data Instances

| Split           | Documents |
|-----------------|----------:|
| `csl`           |      396k |
| `en_translation`|      396k |

### Data Fields

 - `doc_id`: unique identifier for this document
 - `title`: title of the paper
 - `abstract`: abstract of the paper
 - `keywords`: keywords associated with the paper
 - `category`: the broad category of the paper
 - `category_eng`: English translaction of the broad category (e.g., Engineering)
 - `discipline`: academic discipline of the paper
 - `discipline_eng`: English translation of the academic discipline (e.g., Agricultural Engineering)

The `en_translation` contains documents translated from Google Translation service. 
All text are in English, so the fields `category_eng` and `discipline_eng` are omitted. 

## Dataset Usage

Using 🤗 Datasets:

```python
from datasets import load_dataset

dataset = load_dataset('neuclir/csl')['csl']
```

## License & Citation

This dataset is based off the [Chinese Scientific Literature Dataset](https://github.com/ydli-ai/CSL) under Apache 2.0.
The primay change is the addition of `doc_id`s, English translactions of the category and discipline descriptions by a native speaker,
and basic de-duplication. Code that performed this modification is avalable in [this repository](https://github.com/NeuCLIR/csl-preprocess).

If you use this data, please cite:

```
@inproceedings{li-etal-2022-csl,
    title = "{CSL}: A Large-scale {C}hinese Scientific Literature Dataset",
    author = "Li, Yudong  and
      Zhang, Yuqing  and
      Zhao, Zhe  and
      Shen, Linlin  and
      Liu, Weijie  and
      Mao, Weiquan  and
      Zhang, Hui",
    booktitle = "Proceedings of the 29th International Conference on Computational Linguistics",
    month = oct,
    year = "2022",
    address = "Gyeongju, Republic of Korea",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2022.coling-1.344",
    pages = "3917--3923",
}
```

task_categories:text-retrieval task_ids:document-retrieval annotations_creators:no-annotation size_categories:100K<n<1M source_datasets:extended|csl language:zh language:en license:apache-2.0 region:us
{"annotations_creators": ["no-annotation"], "language": ["zh", "en"], "license": ["apache-2.0"], "size_categories": ["100K<n<1M"], "source_datasets": ["extended|csl"], "task_categories": ["text-retrieval"], "task_ids": ["document-retrieval"], "pretty_name": "CSL", "tags": []}
TAGS
#task_categories-text-retrieval #task_ids-document-retrieval #annotations_creators-no-annotation #size_categories-100K<n<1M #source_datasets-extended|csl #language-Chinese #language-English #license-apache-2.0 #region-us 

Dataset Card for CSL
====================


Dataset Description
-------------------


CSL is the Chinese Scientific Literature Dataset.


* Paper: URL
* Repository: URL


### Dataset Summary


The dataset contains titles, abstracts, keywords of papers written in Chinese from several academic fields.


### Languages


* Chinese
* English (translation)


Dataset Structure
-----------------


### Data Instances



### Data Fields


* 'doc\_id': unique identifier for this document
* 'title': title of the paper
* 'abstract': abstract of the paper
* 'keywords': keywords associated with the paper
* 'category': the broad category of the paper
* 'category\_eng': English translaction of the broad category (e.g., Engineering)
* 'discipline': academic discipline of the paper
* 'discipline\_eng': English translation of the academic discipline (e.g., Agricultural Engineering)


The 'en\_translation' contains documents translated from Google Translation service.
All text are in English, so the fields 'category\_eng' and 'discipline\_eng' are omitted.


Dataset Usage
-------------


Using Datasets:


License & Citation
------------------


This dataset is based off the Chinese Scientific Literature Dataset under Apache 2.0.
The primay change is the addition of 'doc\_id's, English translactions of the category and discipline descriptions by a native speaker,
and basic de-duplication. Code that performed this modification is avalable in this repository.


If you use this data, please cite:



### Dataset Summary


The dataset contains titles, abstracts, keywords of papers written in Chinese from several academic fields. ### Languages


* Chinese
* English (translation)


Dataset Structure
----------------- ### Data Instances ### Data Fields


* 'doc\_id': unique identifier for this document
* 'title': title of the paper
* 'abstract': abstract of the paper
* 'keywords': keywords associated with the paper
* 'category': the broad category of the paper
* 'category\_eng': English translaction of the broad category (e.g., Engineering)
* 'discipline': academic discipline of the paper
* 'discipline\_eng': English translation of the academic discipline (e.g., Agricultural Engineering)


The 'en\_translation' contains documents translated from Google Translation service.
All text are in English, so the fields 'category\_eng' and 'discipline\_eng' are omitted.


Dataset Usage
-------------


Using Datasets:


License & Citation
------------------


This dataset is based off the Chinese Scientific Literature Dataset under Apache 2.0.
The primay change is the addition of 'doc\_id's, English translactions of the category and discipline descriptions by a native speaker,
and basic de-duplication. Code that performed this modification is avalable in this repository.


If you use this data, please cite:
TAGS
#task_categories-text-retrieval #task_ids-document-retrieval #annotations_creators-no-annotation #size_categories-100K<n<1M #source_datasets-extended|csl #language-Chinese #language-English #license-apache-2.0 #region-us 
 ### Dataset Summary


The dataset contains titles, abstracts, keywords of papers written in Chinese from several academic fields. ### Languages


* Chinese
* English (translation)


Dataset Structure
----------------- ### Data Instances ### Data Fields


* 'doc\_id': unique identifier for this document
* 'title': title of the paper
* 'abstract': abstract of the paper
* 'keywords': keywords associated with the paper
* 'category': the broad category of the paper
* 'category\_eng': English translaction of the broad category (e.g., Engineering)
* 'discipline': academic discipline of the paper
* 'discipline\_eng': English translation of the academic discipline (e.g., Agricultural Engineering)


The 'en\_translation' contains documents translated from Google Translation service.
All text are in English, so the fields 'category\_eng' and 'discipline\_eng' are omitted.


Dataset Usage
-------------


Using Datasets:


License & Citation
------------------


This dataset is based off the Chinese Scientific Literature Dataset under Apache 2.0.
The primay change is the addition of 'doc\_id's, English translactions of the category and discipline descriptions by a native speaker,
and basic de-duplication. Code that performed this modification is avalable in this repository.


If you use this data, please cite:
passage: TAGS
#task_categories-text-retrieval #task_ids-document-retrieval #annotations_creators-no-annotation #size_categories-100K<n<1M #source_datasets-extended|csl #language-Chinese #language-English #license-apache-2.0 #region-us 
### Dataset Summary


The dataset contains titles, abstracts, keywords of papers written in Chinese from several academic fields.### Languages


* Chinese
* English (translation)


Dataset Structure
-----------------### Data Instances### Data Fields


* 'doc\_id': unique identifier for this document
* 'title': title of the paper
* 'abstract': abstract of the paper
* 'keywords': keywords associated with the paper
* 'category': the broad category of the paper
* 'category\_eng': English translaction of the broad category (e.g., Engineering)
* 'discipline': academic discipline of the paper
* 'discipline\_eng': English translation of the academic discipline (e.g., Agricultural Engineering)


The 'en\_translation' contains documents translated from Google Translation service.
All text are in English, so the fields 'category\_eng' and 'discipline\_eng' are omitted.


Dataset Usage
-------------


Using Datasets:


License & Citation
------------------


This dataset is based off the Chinese Scientific Literature Dataset under Apache 2.0.
The primay change is the addition of 'doc\_id's, English translactions of the category and discipline descriptions by a native speaker,
and basic de-duplication. Code that performed this modification is avalable in this repository.


If you use this data, please cite: