Fine-Tune GPT2 for French/Belgium RAP
GPT2 for French RapFor this project, I propose to use a pretrained GPT2 model in French and fine-tune it to learn to French/Belgium rap.ModelA GPT2 model, pretrained in Belgium/French can be found here:antoiloui/belgpt2 · Hugging FaceDatasetsThe model can be fine-tuned on a variety of publicly available lyrics of rap songs in French/Belgium. The team can choose whatever lyrics they like.Available training scriptsA training script to fine-tune a GPT2 model in Flax is availablehere(Optional) Desired project outcomeThe desired project output is a GPT2 model that candrop barsin French/Belgium. Ideally the model is able to generate a whole rap song.(Optional) ChallengesIt might be difficult to find enough data and to homogenize it well.(Optional) Links to read uponThere are some nice articles on GPT2 models that can rap:GitHub - ewenme/gpt-2-raps: generating lyrics with GPT-2Create a Rapping AI using deep learning | by Max Leander | Analytics Vidhya | Medium