Tensorflow TPUStrategy and model.generate: Does it work?
Hello folks,I’m trying to get GPT-2 in Tensorflow 2.x to generate on TPUs usingtf.distribute.TPUStrategy. This requires compiling the functions withtf.function, but I haven’t had any luck gettingtf.functionto work on aTFGPT2LMHeadModel.Has anyone tried this, and / or had any luck?Thanks.