Finetuing GPT model?
Hi does someone know a fine tuning example with the HF trainer API?Have never fintined a gpt before so any tipis is much appreciated
2021-08-28T16:20:29Z
I’ve never used GPT models before. However, if they are available on huggingface, I guess fine-tuning it won’t be different than fine-tuning any other model. I use PyTorch Lightning for training and replacing any huggingface models with each other wouldn’t change the process I guess…
2021-08-29T14:58:34Z
Thanks for the reply man,i was just wondering about the hyper paramtres used during the fine tuning stage.Is there any guide on that?