Few shot text generation with T5 transformers like GPT-3
Hi HF team,In a very interesting exploration, I explored the T5 transformer for few shot text generation just like GPT-3.The results are impressive. Thought you might be interested in checkinghttps://towardsdatascience.com/poor-mans-gpt-3-few-shot-text-generation-with-t5-transformer-51f1b01f843e?sk=5bb8f20ee72d55a91155289535ab26c5
2021-01-11T07:07:26Z
This looks impressive! Thanks for sharing
2021-01-13T15:27:37Z
Very nice, thank you for writing the article and sharing it!I noticed that you are using Transformers 2.9.0. Have you tried doing the same in more recent versions where a lot of the interface has changed? If so, were you successful or was that the reason you went back to an older version?
2021-01-15T15:13:59Z
Hi@EdwinRijgersberg! Thanks !Since the last write-up, I adapted the code to use the latest HF and also Pytorch Lightning code.You can check it out here:colab.research.google.comGoogle Colaboratory