
This is the filtered Japanese subset of [XL-Sum](https://huggingface.co/datasets/csebuetnlp/xlsum) followed by [PaLM 2](https://arxiv.org/abs/2305.10403)

**filters**
- 15-gram overlap

\* code: https://gist.github.com/mkshing/d6371cbfdd50d4f352cee247fd4dd86a

**number of examples**
- train: 4215 (before: 7113)
- validation: 758 (before: 889)
- test: 766 (before: 889)


task_categories:summarization task_categories:text-classification language:ja license:cc-by-nc-sa-4.0 arxiv:2305.10403 region:us
{"language": ["ja"], "license": "cc-by-nc-sa-4.0", "task_categories": ["summarization", "text-classification"]}
TAGS
#task_categories-summarization #task_categories-text-classification #language-Japanese #license-cc-by-nc-sa-4.0 #arxiv-2305.10403 #region-us 


This is the filtered Japanese subset of XL-Sum followed by PaLM 2

filters
- 15-gram overlap

\* code: URL

number of examples
- train: 4215 (before: 7113)
- validation: 758 (before: 889)
- test: 766 (before: 889)


TAGS
#task_categories-summarization #task_categories-text-classification #language-Japanese #license-cc-by-nc-sa-4.0 #arxiv-2305.10403 #region-us 
