Closest model available to OpenAI's codex/ GitHub Copilot for code completion
Hi everybody,I’m trying to work on a replication study of a paper done using OpenAI’s codex model, and I’m looking for the closest model to it available on the model hub. ThisNovelAI/genji-python-6B · Hugging Faceis the best one I found, but after some testing it seems to often get fixated on code formatting more than the semantics of the program, is the model too small, trained on too little data or is there something better on the model hub?I also checked out codeparrotlvwerra/codeparrot · Hugging Facebut it appears to struggle on longer prompts.Should I try with different hyperparameters?Thank you for any suggestion!
2022-03-01T15:57:29Z
Pinging@lvwerrawho may have some ideas here based on his experience with CodeParrot
2022-03-01T16:13:43Z
You could also tryEleutherAI/gpt-j-6B · Hugging Facewhich was already trained on code and performs pretty well.For the quality of generations it makes sense to tune the sampling strategy. If the first suggestion by the model should be good then you should go for low temperatures whereas if you have several tries you can increase the temperature to get more variety in the generation.
2022-03-01T17:45:43Z
Thanks for the quick reply!I think I didn’t quite understand the value of completed examples/solutions to include in the prompt, adding those improves performance significantly. Do you have any suggestions on literature to better understand sampling strategies/hyperparameters?Btw I’m getting a build error on the code generation demo of CodeParrot,CodeParrot Generation - a Hugging Face Space by lvwerra, it worked fine earlier today though.(works now)
2023-01-30T17:34:56Z
You can try outSantaCoder.
2023-08-07T15:45:57Z
Thank you very much for the link, it’s very helpful.
2023-08-07T15:48:45Z
Ciao Antonioscusa se mi permetto di contattarti ma visto la mia poca esperienza qui e visto che sei italiano anche tu mi chiedevo se fai già parte di qualche gruppo o potresti consigliarmene uno tu. Sono autodidatta in programmazione e mi piacerebbe poter imparare da qualcuno che ne sa piu di me. Per cui per ora buon lavoro e un saluto.luca