How to do selective masking in Language modeling
Hi HuggingfacersI have a number of questions regarding finetuning a language model:How to mask a selective portion of a given input sentence instead of masking randomly.For example, if I am using ALBERT as a model, and I am aiming to do a different kind of loss function than the standard MLM loss  for the masked tokens, how to access the model output of the masked tokens
2020-08-13T14:27:05Z
I think the answer is similar another post:Selective masking in Language modeling
2020-08-13T15:21:18Z
Closing this, since you opened another thread for this and received an answer.