Train a transformer from scratch
Hello,guys!Huggingface/transformersis such a convenient library to use when it comes to all sorts of pertained model. But I am wondering is there a convenient way to train a model from scratch ?If I want to rebuild the model inAttention is all you need, the first thought came into my mind is changemodeling_bart.pyto adapt toAttention is all you needsetting and do notfrom_pretrained, Is there any better way to do it ?I am looking forward to your reply