Generating text with multiple styles using llama
I had an idea to make a llama that can generate text in a certain style. My idea is to train a model like RoBerta and feed the llama with tokenized text and a certain style of embedding. My problem is to combine the embedding of llama with the embedding of RoBerta. Can anyone explain how to pull off my idea, or better yet, give me an example?