HuggingArtists | Train a model to generate lyrics
logo3584×1792 183 KBInHuggingArtists, we can generate lyrics by a specific artist. This was made by fine-tuning a pre-trainedHuggingFace Transformeron parsed datasets fromGenius.As well, we useWeights & Biases integrationto automatically log model performance and predictions.Project repository:AboutCreate training script for TPU with Flax/JAX. So users can choose GPU or TPU in Colab.ModelA pre-trained GPT2 model in English and fine-tune it to learn English lyrics.The GPT2 model, pre-trained in English:link.DatasetsParsed withthis scriptfromGenius.Training scriptsGPU with PyTorch is available in project Colab:So we need to create for TPU with Flax/JAX.Project outcomeCreate training script for TPU with Flax/JAX. So users can choose GPU or TPU in Colab.ChallengesI am new with Flax/JAX, so I need some help.There is no other challengesConclusionWe can integrate this project with Video and Music generation so we can create our AI-ArtistI hope to find like-minded people and create a cool project
2021-08-08T12:56:21Z
Wow this is really cool!
2021-08-08T20:53:47Z
Thank youCan we add this project to “Community Notebooks”?I would be very pleased to be on this list
2021-08-09T05:56:26Z
Sure, we’ll be happy to accept a PR with it!
2021-08-13T20:12:13Z
@sguggerCan I join spaces for this project?
2021-08-19T09:25:53Z
image1918×822 103 KBHuggingArtists and Spaces integration is available now:Huggingartists - a Hugging Face Space by AlekseyKorshukThanks to@osansevierofor adding me to Spaces