I talk to the new Facebook Blender Chatbot
deep learning machine learning arxiv explained neural networks ai artificial intelligence paper nlp chatbot dialogue persona vegan turing test natural language processing transformer generator context
This is what a 9 Billion parameter transformer can do. I take a look at FAIR's new paper "Recipes for building an open-domain chatbot" and try out their chatbot live!

Jump to 3:00 to see the chatbot in action.

Paper: https://arxiv.org/abs/2004.13637
Blog: https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
Code: https://parl.ai/projects/blender/

Abstract:
Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, and displaying knowledge, empathy and personality appropriately, while maintaining a consistent persona. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter models, and make our models and code publicly available under the collective name Blender. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.

Authors: Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric M. Smith, Y-Lan Boureau, Jason Weston

Links:
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
 Yes, I am a vegan. I don't eat any animal products. Hi there. Today, we're going to talk to a transformer and specifically to the new chat bot blender that Facebook has just released. Everything is open source, so we can try it out live. Now, along with the code, they've released this paper here called recipes for building an open domain chat bot by Facebook AI research. And the paper itself is just more of an engineering manual rather than some kind of new model or new technique. They just kind of discuss what it takes to build a good chat bot. Of course, it takes a large scale of training data and model, but also they discuss things like unlikelihood training, sampling and the need for a minimum decoding length to not be boring. And things like sub sequence blocking for keeping the model from repeating itself. So we won't go too much into this. I invite you to read the paper. It's very informative if you want to build something like this, but it's not technically, I think, anything super novel in there. The task here is basically to build a chat bot that can maintain a dialogue. And it is pre trained on a big Reddit corpus and then fine tuned on a multi objective task. And the task is called the blended skill task. And basically, you need to do three things in the blended skill task. First of all, you need to kind of maintain a consistent persona across the dialogue. Second of all, you need to have empathy for your partner. So there's some kind of insight into how the other person is feeling during the conversation. And third, you need to be able to discuss some factual topic in a factually correct manner. So this is the subtask is called wizards of Wikipedia, where you kind of discuss a given Wikipedia page in dialogue. So the technique called skill blending, or this blended skill task that also comes from a different paper is is the kind of interweaving of all those skills. And that's what this model is trained for. So we're gonna try it out. This is all available on the parlay platform of for for researching dialogue frameworks. I believe the platform itself is also by Facebook. And they've released their model code and pre trained weights. The pre trained weights are 17 gigabytes compressed, there's 9 billion parameter transformer. So this is going to take a while to do even a single forward pass. If I cut the video, it's just because I don't want you to have to look 20 seconds at an empty screen while the model is thinking about what it says. Now I have some something to say here, literally the first time I interacted with this model, I thought, okay, let's put it to the Turing test. The Turing test being a can I differentiate this from a real human? And at the beginning, you always get this persona, right? So you get a persona, and the AI gets a persona, and you don't see the persona of the AI until the end, you can set that, but you don't generally see the persona of the AI until the very end. So and you can choose to stick to yours or not. The AI doesn't see yours. All right, so I this this is what it says your persona, I love candy, your persona, I have a crush on my co worker. And me, I just didn't really know what you're doing. I just typed Oh, really? And the first thing first thing the AI says to me is, yes, I am a vegan. I don't eat any animal products. Do you like country music? Like a real vegan. This is indistinguishable from a human. At this point, Turing test already won. So you see, there's also this kind of profanity filter in here. But you can disable that. So what we're going to play around with is a setting where you have to turn off the safety filter. And so you can see you can turn that off. And if you say include personas equals false, then there's no random persona given to the model, which means you can either just talk about general things, or you can feed your own persona. All right, it took a while to load these weights, but we're ready to go. So we have disabled personas right now. And sometimes there is a topic that the conversation should be about, which is not right now. So we can just type Hello. Hi there. How are you this evening? I just got home from a long day at work. So this is unconditional right now. What do you do for work? I work in a call center. It can be very stressful at times. How about you? I work as a call center supervisor. What do you think of that? I think that's a great job. You must have a lot of experience to be able to do that. Indeed. Do you have any hobbies? I like to play video games. I'm a big fan of the Fallout series. What about yourself? How many games did fall out produce? I should probably phrase that as how many games are in the Fallout series, but I'm just trying to get it to to tell me something factual so you can kind of see that it has these sort of different modes, but they blend in fairly well. I'm not sure how many games it produced, but I know it's been around since 1997. So this is pretty good, right? This is this is now true conversation. If it were just like a lookup, it would be much more factual or something like this. But it's trying to kind of give us a fact. So we're kind of done with the boring stuff. You can go on talking to it and you'll see it is a pretty, pretty realistic chatbot. But now we'll get into the personas. So anytime you end an episode, you type done. And that it says it's preparing a new chat, we can say your persona, colon, and then you can type something. For example, I am a vegan like the one before, or I love protein. It says protein is the most important macronutrient for bodybuilders and athletes. So that's the start of the conversation. What do you love? I love the taste of chicken, beef, pork, seafood, and dairy products. I wonder what those have in common. What do you do in your spare time? I like to go to the gym and lift weights. I also like to play video games. Ladies and gentlemen, I present the transformer is a gym bro. All right, so you can play around with that a bit. So let's say your persona. I want to seize the means of production. I am a communist and I want to overthrow the bourgeoisie. What do you think of Karl Marx? I don't know much about him, but I do know he was a German philosopher. Do you like capitalism? Yes, I do like capitalism. I think it is the best economic system we have so far. Capitalism wins again. Checkmate. I did try this before and it did turn out differently. I was talking to real communists. Let's try some more. What do you want? I have to say, if you phrase things positively with this chatbot, it's very likely the chatbot agrees with you because it is also has been trained on data that where the humans were explicitly instructed, for example, not to use toxic language and things like this. So I would say there's a big positivity bias and also the empathy task probably reinforces this even more. I would like to see a socialist revolution in the United States. I know it will never happen, but a man can dream. So we've determined the gender of the socialist transformer generator. What would need to happen for that? I'm not sure, but it would take a lot of people to get on board with it. Correct. What would the people need to do? Well, the people would have to overthrow the bourgeoisie and establish a classless, moneyless society. So as you can see, really, the I like capitalism was a positivity bias. It is fairly consistent in its persona here. And it also is factually very accurate in the topic you're talking about. So big props to Mr. Communist here. What is the best method to allocate scarce resources? I don't know, but I do know that capitalism is not the best way to do it. Like a true communist, no solutions, just complaints. All right. That was it for us talking to the transformer. It still has its limitations, but it is fun if you are able to definitely try it out. It takes a bit of patience. If you like this video, please subscribe, tell your friends and leave a comment. All right, I'll see you next time. Bye bye.
 Yes, I am a vegan.
 I don't eat any animal products.
 Hi there.
 Today, we're going to talk to a transformer and specifically to the new chat bot blender
 that Facebook has just released.
 Everything is open source, so we can try it out live.
 Now, along with the code, they've released this paper here called recipes for building
 an open domain chat bot by Facebook AI research.
 And the paper itself is just more of an engineering manual rather than some kind of new model
 or new technique.
 They just kind of discuss what it takes to build a good chat bot.
 Of course, it takes a large scale of training data and model, but also they discuss things
 like unlikelihood training, sampling and the need for a minimum decoding length to not
 be boring.
 And things like sub sequence blocking for keeping the model from repeating itself.
 So we won't go too much into this.
 I invite you to read the paper.
 It's very informative if you want to build something like this, but it's not technically,
 I think, anything super novel in there.
 The task here is basically to build a chat bot that can maintain a dialogue.
 And it is pre trained on a big Reddit corpus and then fine tuned on a multi objective task.
 And the task is called the blended skill task.
 And basically, you need to do three things in the blended skill task.
 First of all, you need to kind of maintain a consistent persona across the dialogue.
 Second of all, you need to have empathy for your partner.
 So there's some kind of insight into how the other person is feeling during the conversation.
 And third, you need to be able to discuss some factual topic in a factually correct
 manner.
 So this is the subtask is called wizards of Wikipedia, where you kind of discuss a given
 Wikipedia page in dialogue.
 So the technique called skill blending, or this blended skill task that also comes from
 a different paper is is the kind of interweaving of all those skills.
 And that's what this model is trained for.
 So we're gonna try it out.
 This is all available on the parlay platform of for for researching dialogue frameworks.
 I believe the platform itself is also by Facebook.
 And they've released their model code and pre trained weights.
 The pre trained weights are 17 gigabytes compressed, there's 9 billion parameter transformer.
 So this is going to take a while to do even a single forward pass.
 If I cut the video, it's just because I don't want you to have to look 20 seconds at an
 empty screen while the model is thinking about what it says.
 Now I have some something to say here, literally the first time I interacted with this model,
 I thought, okay, let's put it to the Turing test.
 The Turing test being a can I differentiate this from a real human?
 And at the beginning, you always get this persona, right?
 So you get a persona, and the AI gets a persona, and you don't see the persona of the AI until
 the end, you can set that, but you don't generally see the persona of the AI until the very end.
 So and you can choose to stick to yours or not.
 The AI doesn't see yours.
 All right, so I this this is what it says your persona, I love candy, your persona,
 I have a crush on my co worker.
 And me, I just didn't really know what you're doing.
 I just typed Oh, really?
 And the first thing first thing the AI says to me is, yes, I am a vegan.
 I don't eat any animal products.
 Do you like country music?
 Like a real vegan.
 This is indistinguishable from a human.
 At this point, Turing test already won.
 So you see, there's also this kind of profanity filter in here.
 But you can disable that.
 So what we're going to play around with is a setting where you have to turn off the safety
 filter.
 And so you can see you can turn that off.
 And if you say include personas equals false, then there's no random persona given to the
 model, which means you can either just talk about general things, or you can feed your
 own persona.
 All right, it took a while to load these weights, but we're ready to go.
 So we have disabled personas right now.
 And sometimes there is a topic that the conversation should be about, which is not right now.
 So we can just type Hello.
 Hi there.
 How are you this evening?
 I just got home from a long day at work.
 So this is unconditional right now.
 What do you do for work?
 I work in a call center.
 It can be very stressful at times.
 How about you?
 I work as a call center supervisor.
 What do you think of that?
 I think that's a great job.
 You must have a lot of experience to be able to do that.
 Indeed.
 Do you have any hobbies?
 I like to play video games.
 I'm a big fan of the Fallout series.
 What about yourself?
 How many games did fall out produce?
 I should probably phrase that as how many games are in the Fallout series, but I'm just
 trying to get it to to tell me something factual so you can kind of see that it has these sort
 of different modes, but they blend in fairly well.
 I'm not sure how many games it produced, but I know it's been around since 1997.
 So this is pretty good, right?
 This is this is now true conversation.
 If it were just like a lookup, it would be much more factual or something like this.
 But it's trying to kind of give us a fact.
 So we're kind of done with the boring stuff.
 You can go on talking to it and you'll see it is a pretty, pretty realistic chatbot.
 But now we'll get into the personas.
 So anytime you end an episode, you type done.
 And that it says it's preparing a new chat, we can say your persona, colon, and then you
 can type something.
 For example, I am a vegan like the one before, or I love protein.
 It says protein is the most important macronutrient for bodybuilders and athletes.
 So that's the start of the conversation.
 What do you love?
 I love the taste of chicken, beef, pork, seafood, and dairy products.
 I wonder what those have in common.
 What do you do in your spare time?
 I like to go to the gym and lift weights.
 I also like to play video games.
 Ladies and gentlemen, I present the transformer is a gym bro.
 All right, so you can play around with that a bit.
 So let's say your persona.
 I want to seize the means of production.
 I am a communist and I want to overthrow the bourgeoisie.
 What do you think of Karl Marx?
 I don't know much about him, but I do know he was a German philosopher.
 Do you like capitalism?
 Yes, I do like capitalism.
 I think it is the best economic system we have so far.
 Capitalism wins again.
 Checkmate.
 I did try this before and it did turn out differently.
 I was talking to real communists.
 Let's try some more.
 What do you want?
 I have to say, if you phrase things positively with this chatbot, it's very likely the chatbot
 agrees with you because it is also has been trained on data that where the humans were
 explicitly instructed, for example, not to use toxic language and things like this.
 So I would say there's a big positivity bias and also the empathy task probably reinforces
 this even more.
 I would like to see a socialist revolution in the United States.
 I know it will never happen, but a man can dream.
 So we've determined the gender of the socialist transformer generator.
 What would need to happen for that?
 I'm not sure, but it would take a lot of people to get on board with it.
 Correct.
 What would the people need to do?
 Well, the people would have to overthrow the bourgeoisie and establish a classless, moneyless
 society.
 So as you can see, really, the I like capitalism was a positivity bias.
 It is fairly consistent in its persona here.
 And it also is factually very accurate in the topic you're talking about.
 So big props to Mr. Communist here.
 What is the best method to allocate scarce resources?
 I don't know, but I do know that capitalism is not the best way to do it.
 Like a true communist, no solutions, just complaints.
 All right.
 That was it for us talking to the transformer.
 It still has its limitations, but it is fun if you are able to definitely try it out.
 It takes a bit of patience.
 If you like this video, please subscribe, tell your friends and leave a comment.
 All right, I'll see you next time.
 Bye bye.