Corpus for pre train bert base chinese
I want to actually distill bert base chinese model from google. But can find the dataset used to do pre train bert base chinese. Chinese corpus is kind of rare on internet. So any information is appreciated
2024-09-14T13:33:19Z
True. I followed the link and the Chinese dataset doesn’t come up…huggingface.cogoogle-bert/bert-base-chinese · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.cogoogle-bert/bert-base-uncased · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.https://yknzhu.wixsite.com/mbweben.wikipedia.orgEnglish WikipediaThe English Wikipedia is the primary[a] English-language edition of Wikipedia, an online encyclopedia. It was created by Jimmy Wales and Larry Sanger on 15 January 2001, as Wikipedia's first edition.
 English Wikipedia is hosted alongside other language editions by the Wikimedia Foundation, an American nonprofit organization. Its content is written independently of other editions in various varieties of English, aiming to stay consistent within articles. Its internal newspaper is The Signpost...I see a lot of Chinese people on HF (maybe), so I’m sure you can find someone who might know and ask them directly by opening a Discussion… or send a mention and they’ll notice.I’ve sorted the Chinese datasets by popularity, but I wonder if any of them are above this one.huggingface.coHugging Face – The AI community building the future.We’re on a journey to advance and democratize artificial intelligence through open source and open science.By the way, how to look for them, for example, if you follow the people who like the following data set (actually, you can), you have a pretty good chance that they are Chinese speakers. Well, not me.huggingface.cob3x0m/Chinese-H-Novels · Datasets at Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.