How to pre-train the language model in huggingface?
Hello every one. I am a master course student in AI. As a researcher, I want to make better language model in the text-summarization field. To do this, I want to know how pre-train the model. In huggingface, most of models are already pre-trained and only focus on the fine-tuning. If you know about that how to pre-train the model for the text-summraization(pegasus, bart ect) please let me know. Thanks.