GPT2 with TensorFlow?
I tried doing this at the start without luck. I was wondering if anyone was successful at eval/retrain GPT2 with TensorFlow instead of pyTorch? I guess there are some ports directly in TF. However, my question is related to the Transformers library.
2020-11-14T07:51:14Z
I am not aware of public notebooks regarding training Huggingface’s TFGPT2, but we have public notebooks of training TFT5 and TFXLM-R , which should give you some ideasTF-T5colab.research.google.comGoogle ColaboratoryTF-XLM-Rkaggle.comFinetune XLM-Roberta on Jigsaw test data with MLMExplore and run machine learning code with Kaggle Notebooks | Using data from multiple data sources