How to fine tune fine tune GitHub Copilot?
We can fine tune language models like BERT, GPT-3.Can I fine tune GitHub Copilot model?I have already looked into thehttps://copilot.github.com/but cant find the details. Would really appreciate if someone had fine tuned Github Copilot.
2022-06-09T12:34:10Z
Hi@neo-benjaminThe Codex model that’s powering the Copilot product is not open sourced. However, there are a few models similar to Codex available on the Hugging Face Hub such as Incoder or CodeGen:huggingface.cofacebook/incoder-6B · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coSalesforce/codegen-16B-multi · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2022-06-09T20:19:57Z
How to fine tune Codegen? Are the steps documented?
2022-06-24T13:40:30Z
You can have a look at the language modeling examples. The should work for any auto regressive model such as GPT-2 or CodeGen:transformers/examples/pytorch/language-modeling at main · huggingface/transformers · GitHub