Masked Language Modeling (MLM) using TFBertForMaskedLM (Tensorflow)
Where can I find a complete example on how to fine tune a model using Tensorflow for TFBertForMaskedLM for custom text dataset using transformers and Tensorflow instead of PyTorch. I have an working example using PyTorch but I need an example with Tensorflow. Can someone guide me here?
2020-11-12T09:48:21Z
Looking for the same thing! Have you found a good example by now?
2021-01-19T10:39:24Z
Hi,I am also looking for the same thing. Any luck finding more information about this?Thanks,Ayala
2021-01-19T15:34:59Z
You can create tf records using any data. Have a look at Bert official repo. Then pass tf records to TFBert.  But yes it’s not straight forward as PyTorch.
2021-01-21T07:58:24Z
Thanks! I will take a look.