Where to find the "wiki-big.train.raw" data as mentioned in the snippet for tokenizers 0.9?
I came across this short snippet of code on LinkedIn by HuggingFace, introducing tokenizers 0.9.LinkedIn URL:snippet fortokenizers0.9How do I get the following dataset to run the code snippet? Is it available onhuggingface.datasets?files = ["../../data/wiki-big.train.raw"]
2020-10-29T09:53:40Z
This datasetcan probably get you started.This gistby@thomwolfmay also prove useful.
2020-10-29T10:04:17Z
Thank you.