

A blog on how to Finetune a non-English GPT-2 Model with Hugging Face.
A blog on How to generate text: using different decoding methods for language generation with Transformers with GPT-2.
A blog on Training CodeParrot 🦜 from Scratch, a large GPT-2 model.
A blog on Faster Text Generation with TensorFlow and XLA with GPT-2.
A blog on How to train a Language Model with Megatron-LM with a GPT-2 model.
A notebook on how to finetune GPT2 to generate lyrics in the style of your favorite artist. 🌎
A notebook on how to finetune GPT2 to generate tweets in the style of your favorite Twitter user. 🌎
Causal language modeling chapter of the 🤗 Hugging Face Course.
[OpenAIGPTLMHeadModel] is supported by this causal language modeling example script, text generation example script and notebook.
[TFOpenAIGPTLMHeadModel] is supported by this causal language modeling example script and notebook.
See also: Causal language modeling task guide