Fine-Tune GPT2 for German Rap
GPT2 for German RapFor this project, I propose to use a pretrained GPT2 model in Gerrman and fine-tune it to learn to German rap.ModelA GPT2 model, pretrained in German can be found here:dbmdz/german-gpt2 · Hugging FaceDatasetsThe model can be fine-tuned on a variety of publicly available lyrics of rap songs in German. The team can choose whatever lyrics they like.Available training scriptsA training script to fine-tune a GPT2 model in Flax is availablehere(Optional) Desired project outcomeThe desired project output is a GPT2 model that candrop barsin German. Ideally the model is able to generate a whole rap song.(Optional) ChallengesIt might be difficult to find enough data and to homogenize it well.(Optional) Links to read uponThere are some nice articles on GPT2 models that can rap:GitHub - ewenme/gpt-2-raps: generating lyrics with GPT-2Create a Rapping AI using deep learning | by Max Leander | Analytics Vidhya | Medium