Is TFAlbert model pre-trainable?
Hello,I’m interested in pre-training the Albert model on a large set of domain specific data. I see on GitHub that there is aTFAlbertForPreTrainingclass, but it is not showing up in the docs.Is this class only there for the loading of pre-trained Albert models, or can I make use of this to do pre-training myself?
2020-07-15T21:14:42Z
I think the team just forgot to put them in the docs. You can make a PR to add them or I’ll fix that next week when I’m back from vacation.