
# Dataset Card for Thai Literature Corpora (TLC)

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://attapol.github.io/tlc.html
- **Leaderboard:** https://www.kaggle.com/c/wisesight-sentiment/
- **Paper:**
- **Leaderboard:** 
- **Point of Contact:**  Jitkapat Sawatphol, Attapol Rutherford; attapolrutherford at gmail.com

### Dataset Summary
Thai Literature Corpora (TLC): Corpora of machine-ingestible Thai classical literature texts.

It consists of two datasets:

## TLC set
It is texts from [Vajirayana Digital Library](https://vajirayana.org/), stored by chapters and stanzas (non-tokenized).

tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)

## TNHC set
It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).

tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)

### Supported Tasks and Leaderboards

Language Modeling, Language Generation


### Languages

Thai

## Dataset Structure

### Data Instances

```
{
    "ch_num": "๑",
    "title": "กากี กลอนสุภาพ",
    "text": [
      [
        "๏ จักกล่าวอดีตนิทานแต่ปางก่อน\n",
        "เมื่อครั้งองค์สมเด็จพระชินวร\tยังสัญจรแสวงหาโพธิญาณ\n",
        "เสวยชาติเป็นสกุณาพระยานก\tจึงชักเรื่องชาดกมาบรรหาร\n",
        "หวังแสดงแห่งจิตหญิงพาล\tให้ชายชาญรู้เชิงกระสัตรี ฯ\n"
      ]
}
```

### Data Fields

- `ch_num`: chapter number in Thai Numerals (๑, ๒, ๓, ๔, ๕, ๖, ๗, ๘, ๙, ๑๐, ...)  
- `title`: chapter name
- `text`: each item corresponds to one stanzas, each line is a couplet which can be seperated by `\t`

### Data Splits

tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)

## TNHC set
It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).

tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)

|           | tlc2.0 | tlc1.0 | tnhc  |
|-----------|-------|-------|-------|
| # documents | 34 | 25  | 47  |
| # lines     | 292,270 | 113,981  | 756,478  |

## Dataset Creation

### Curation Rationale

Originally, the dataset was compiled for the [Thai Poetry Generator](https://github.com/jitkapat/thaipoetrygenerator) at Chulalongkorn university as the Final project for `2209372 Introduction to Computational Linguistics` by [Jitkapat Sawatphol](https://jitkapat.github.io/) (Faculty of Engineering, Chulalongkorn University).

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]


#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

There is no personal information.

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]


## Additional Information

### Dataset Curators

Thanks [Jitkapat Sawatphol](https://jitkapat.github.io/) (Faculty of Arts, Chulalongkorn University), and [Attapol Rutherford](https://attapol.github.io/) (Faculty of Arts, Chulalongkorn University)

### Licensing Information

[More Information Needed]

### Citation Information

Please cite the following if you make use of the dataset:

Jitkapat Sawatphol, and Attapol Rutherford. 2019. **Thai Literature Corpora (TLC)**.

BibTeX:
```
@misc{
  author={Sawatphol, Jitkapat},
  title={Thai Literature Corpora},
  year={2019},
  howpublished={\\url{https://attapol.github.io/tlc.html}}
}
```

### Contributions

Thanks to [@chameleonTK](https://github.com/chameleonTK) for adding this dataset.
task_categories:text-generation task_categories:fill-mask task_ids:language-modeling task_ids:masked-language-modeling annotations_creators:expert-generated annotations_creators:no-annotation language_creators:expert-generated multilinguality:monolingual size_categories:n<1K source_datasets:original language:th license:unknown region:us
{"annotations_creators": ["expert-generated", "no-annotation"], "language_creators": ["expert-generated"], "language": ["th"], "license": ["unknown"], "multilinguality": ["monolingual"], "size_categories": ["n<1K"], "source_datasets": ["original"], "task_categories": ["text-generation", "fill-mask"], "task_ids": ["language-modeling", "masked-language-modeling"], "pretty_name": "Thai Literature Corpora (TLC)", "dataset_info": [{"config_name": "tlcv1.0", "features": [{"name": "ch_num", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "text", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 32498, "num_examples": 1}], "download_size": 2904472, "dataset_size": 32498}, {"config_name": "tlcv2.0", "features": [{"name": "ch_num", "dtype": "string"}, {"name": "title", "dtype": "string"}, {"name": "text", "sequence": {"sequence": "string"}}], "splits": [{"name": "train", "num_bytes": 32498, "num_examples": 1}], "download_size": 5551710, "dataset_size": 32498}, {"config_name": "tnhcv1.0", "features": [{"name": "text", "sequence": "string"}], "splits": [{"name": "train", "num_bytes": 25198, "num_examples": 152}], "download_size": 1465403, "dataset_size": 25198}]}
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #annotations_creators-expert-generated #annotations_creators-no-annotation #language_creators-expert-generated #multilinguality-monolingual #size_categories-n<1K #source_datasets-original #language-Thai #license-unknown #region-us 

Dataset Card for Thai Literature Corpora (TLC)
==============================================


Table of Contents
-----------------


* Dataset Description
	+ Dataset Summary
	+ Supported Tasks and Leaderboards
	+ Languages
* Dataset Structure
	+ Data Instances
	+ Data Fields
	+ Data Splits
* Dataset Creation
	+ Curation Rationale
	+ Source Data
	+ Annotations
	+ Personal and Sensitive Information
* Considerations for Using the Data
	+ Social Impact of Dataset
	+ Discussion of Biases
	+ Other Known Limitations
* Additional Information
	+ Dataset Curators
	+ Licensing Information
	+ Citation Information
	+ Contributions


Dataset Description
-------------------


* Homepage: URL
* Leaderboard: URL
* Paper:
* Leaderboard:
* Point of Contact: Jitkapat Sawatphol, Attapol Rutherford; attapolrutherford at URL


### Dataset Summary


Thai Literature Corpora (TLC): Corpora of machine-ingestible Thai classical literature texts.


It consists of two datasets:


TLC set
-------


It is texts from Vajirayana Digital Library, stored by chapters and stanzas (non-tokenized).


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)


### Supported Tasks and Leaderboards


Language Modeling, Language Generation


### Languages


Thai


Dataset Structure
-----------------


### Data Instances


### Data Fields


* 'ch\_num': chapter number in Thai Numerals (๑, ๒, ๓, ๔, ๕, ๖, ๗, ๘, ๙, ๑๐, ...)
* 'title': chapter name
* 'text': each item corresponds to one stanzas, each line is a couplet which can be seperated by '\t'


### Data Splits


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)



Dataset Creation
----------------


### Curation Rationale


Originally, the dataset was compiled for the Thai Poetry Generator at Chulalongkorn university as the Final project for '2209372 Introduction to Computational Linguistics' by Jitkapat Sawatphol (Faculty of Engineering, Chulalongkorn University).


### Source Data


#### Initial Data Collection and Normalization


#### Who are the source language producers?


### Annotations


#### Annotation process


#### Who are the annotators?


### Personal and Sensitive Information


There is no personal information.


Considerations for Using the Data
---------------------------------


### Social Impact of Dataset


### Discussion of Biases


### Other Known Limitations


Additional Information
----------------------


### Dataset Curators


Thanks Jitkapat Sawatphol (Faculty of Arts, Chulalongkorn University), and Attapol Rutherford (Faculty of Arts, Chulalongkorn University)


### Licensing Information


Please cite the following if you make use of the dataset:


Jitkapat Sawatphol, and Attapol Rutherford. 2019. Thai Literature Corpora (TLC).


BibTeX:


### Contributions


Thanks to @chameleonTK for adding this dataset.



### Dataset Summary


Thai Literature Corpora (TLC): Corpora of machine-ingestible Thai classical literature texts.


It consists of two datasets:


TLC set
-------


It is texts from Vajirayana Digital Library, stored by chapters and stanzas (non-tokenized).


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters) ### Supported Tasks and Leaderboards


Language Modeling, Language Generation ### Languages


Thai


Dataset Structure
----------------- ### Data Instances ### Data Fields


* 'ch\_num': chapter number in Thai Numerals (๑, ๒, ๓, ๔, ๕, ๖, ๗, ๘, ๙, ๑๐, ...)
* 'title': chapter name
* 'text': each item corresponds to one stanzas, each line is a couplet which can be seperated by '\t' ### Data Splits


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)



Dataset Creation
---------------- ### Curation Rationale


Originally, the dataset was compiled for the Thai Poetry Generator at Chulalongkorn university as the Final project for '2209372 Introduction to Computational Linguistics' by Jitkapat Sawatphol (Faculty of Engineering, Chulalongkorn University). ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


There is no personal information.


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


Thanks Jitkapat Sawatphol (Faculty of Arts, Chulalongkorn University), and Attapol Rutherford (Faculty of Arts, Chulalongkorn University) ### Licensing Information


Please cite the following if you make use of the dataset:


Jitkapat Sawatphol, and Attapol Rutherford. 2019. Thai Literature Corpora (TLC).


BibTeX: ### Contributions


Thanks to @chameleonTK for adding this dataset.
TAGS
#task_categories-text-generation #task_categories-fill-mask #task_ids-language-modeling #task_ids-masked-language-modeling #annotations_creators-expert-generated #annotations_creators-no-annotation #language_creators-expert-generated #multilinguality-monolingual #size_categories-n<1K #source_datasets-original #language-Thai #license-unknown #region-us 
 ### Dataset Summary


Thai Literature Corpora (TLC): Corpora of machine-ingestible Thai classical literature texts.


It consists of two datasets:


TLC set
-------


It is texts from Vajirayana Digital Library, stored by chapters and stanzas (non-tokenized).


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters) ### Supported Tasks and Leaderboards


Language Modeling, Language Generation ### Languages


Thai


Dataset Structure
----------------- ### Data Instances ### Data Fields


* 'ch\_num': chapter number in Thai Numerals (๑, ๒, ๓, ๔, ๕, ๖, ๗, ๘, ๙, ๑๐, ...)
* 'title': chapter name
* 'text': each item corresponds to one stanzas, each line is a couplet which can be seperated by '\t' ### Data Splits


tlc v.2.0 (6/17/19 : a total of 34 documents, 292,270 lines, 31,790,734 characters)
tlc v.1.0 (6/11/19 : a total of 25 documents, 113,981 lines, 28,775,761 characters)


TNHC set
--------


It is texts from Thai National Historical Corpus, stored by lines (manually tokenized).


tnhc v.1.0 (6/25/19 : a total of 47 documents, 756,478 lines, 13,361,142 characters)



Dataset Creation
---------------- ### Curation Rationale


Originally, the dataset was compiled for the Thai Poetry Generator at Chulalongkorn university as the Final project for '2209372 Introduction to Computational Linguistics' by Jitkapat Sawatphol (Faculty of Engineering, Chulalongkorn University). ### Source Data #### Initial Data Collection and Normalization #### Who are the source language producers? ### Annotations #### Annotation process #### Who are the annotators? ### Personal and Sensitive Information


There is no personal information.


Considerations for Using the Data
--------------------------------- ### Social Impact of Dataset ### Discussion of Biases ### Other Known Limitations


Additional Information
---------------------- ### Dataset Curators


Thanks Jitkapat Sawatphol (Faculty of Arts, Chulalongkorn University), and Attapol Rutherford (Faculty of Arts, Chulalongkorn University) ### Licensing Information


Please cite the following if you make use of the dataset:


Jitkapat Sawatphol, and Attapol Rutherford. 2019. Thai Literature Corpora (TLC).


BibTeX: ### Contributions


Thanks to @chameleonTK for adding this dataset.