A notebook on fine-tuning OPT with PEFT, bitsandbytes, and Transformers. 🌎
A blog post on decoding strategies with OPT.
Causal language modeling chapter of the 🤗 Hugging Face Course.
[OPTForCausalLM] is supported by this causal language modeling example script and notebook.
[TFOPTForCausalLM] is supported by this causal language modeling example script and notebook.
[FlaxOPTForCausalLM] is supported by this causal language modeling example script.