When to use Hub and when to use Datasets
Hi, is there a policy for when a new dataset should be placed on Hub and when it’s best to send it into Datasets?
2022-05-06T13:45:12Z
most new datasets should be placed on the Hub.Exceptions are if for instance there’s no “natural” organization or user to attach it too, AND it’s an “important” datasetcc@lhoestq@osanseviero
2022-05-06T14:13:13Z
According to our docs:ShareIn some cases it makes more sense to open a PR on GitHub:when you need the dataset to be reviewedwhen you need long-term maintenance from the Hugging Face teamwhen there’s no clear org name / namespace that you can put the dataset under
2022-05-06T14:26:26Z
Ah, in this case I’m even more honoured to have had a corpus placed on datasets github by the hf team! Thank you!