AI-Artist | GPT2 English Song Writer
With the help of this project, users will be able to choose a musical genre and then receive the lyrics of the song.ModelI think we can use a pre-trained GPT2 model in English and fine-tune it to learn English lyrics.The GPT2 model, pre-trained in English:link.DatasetsWe can parse the needed datasets (ex.:Genius API) or combine open-source datasets, and make them publicTraining scriptsI known at least 2 public scripts to fine-tune a GPT2 model in Flax:From huggingface/transformers GitHub“Causal Language Model Training in TPU withTransformers & JAX”Project outcomeThe desired project output is a model that can generate a whole song by genre.ChallengesCreate a cool datasetAllow choosing a genreOptionalAlso, it would be cool to allow users to choose an artist but there are some cons…ConclusionWe can integrate this project with Video and Music generation so we can create our AI-ArtistI hope to find like-minded people and create a cool project