Are the weights of the maskedLM head of the `BertForMaskedLM` model pre-trained?
Hello,Are the weights of the maskedLM output head of theBertForMaskedLMmodel pre-trained?Or are the weights of the maskedLM output head randomly initialized each time the model is called?Thank you,