
# Traditional Chinese C4

### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using [code](https://github.com/jedcheng/c4-dataset-script) based on another [project](https://github.com/shjwudp/c4-dataset-script) attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a [modified list](https://github.com/jedcheng/c4-dataset-script/blob/master/SC_filter/SC_list.txt) of simplified Chinese characters to obtain [another traditional Chinese dataset](https://huggingface.co/datasets/jed351/Traditional-Chinese-Common-Crawl-Filtered).



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (http://doi.org/10.14469/hpc/2232)
language:zh region:us
{"language": ["zh"]}
TAGS
#language-Chinese #region-us 


# Traditional Chinese C4

### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using code based on another project attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a modified list of simplified Chinese characters to obtain another traditional Chinese dataset.



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (URL
# Traditional Chinese C4 ### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using code based on another project attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a modified list of simplified Chinese characters to obtain another traditional Chinese dataset.



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (URL
TAGS
#language-Chinese #region-us 
 # Traditional Chinese C4 ### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using code based on another project attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a modified list of simplified Chinese characters to obtain another traditional Chinese dataset.



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (URL
passage: TAGS
#language-Chinese #region-us 
# Traditional Chinese C4### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using code based on another project attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a modified list of simplified Chinese characters to obtain another traditional Chinese dataset.



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (URL