[ML News] Stable Diffusion Takes Over! (Open Source AI Art)
deep learning machine learning arxiv explained neural networks ai artificial intelligence paper stablediffusion stable diffusion ml news mlnews ml news yannic yannick ml news what is deep learning introduction to deep learning deep learning tutorial
#stablediffusion #aiart #mlnews 

Stable Diffusion has been released and is riding a wave of creativity and collaboration. But not everyone is happy about this...

Sponsor: NVIDIA
GPU Raffle: https://ykilcher.com/gtc

OUTLINE:
0:00 - Introduction
0:30 - What is Stable Diffusion?
2:25 - Open-Source Contributions and Creations
7:55 - Textual Inversion
9:30 - OpenAI vs Open AI
14:20 - Journalists be outraged
16:20 - AI Ethics be even more outraged
19:45 - Do we need a new social contract?
21:30 - More applications
22:55 - Helpful Things
23:45 - Sponsor: NVIDIA (& how to enter the GPU raffle)

References: https://early-hair-c20.notion.site/Stable-Diffusion-Takes-Over-Referenes-7a2f45b8f7e04ae0ba19dbfcd2b7f7c0

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
 Stable Diffusion has been released to the public and the world is creative as never before. It's an explosion of creativity, collaboration and open improvement. But not everyone is happy. Today we'll look at how Stable Diffusion works, how it impacts the world and what people say about it. Welcome to a special edition of ML News. Remember, Emma Stuck, who I had as an interview guest here on the channel, the founder of stability AI has announced on August 22, the public open source release of Stable Diffusion. Stable Diffusion is a text to image model, you give it a piece of text, and it makes an image and the images it creates are stunning. This image right here, these images are created by Stable Diffusion. This is not Photoshop, this doesn't just adjust a little bit an existing image, it creates images from pure text. So the cool thing about Stable Diffusion is that while similar models have been just available behind an API like open AI's dali, this is completely in the open, you can just download the model and do whatever you want with it. A small point, there is actually a license on it, but it's very permissive. So almost whatever you want. Specifically, you can change it, you can update it, you can monetize it, and all of that stuff. It's been trained on a subset of the lion 5b data set that's been filtered for specifically aesthetically pleasing images. And that is a big part of why the results are so amazing. And the craziest thing about all of this is this model does not need a data center to run, it can actually run on a single GPU. Look, this thing right here is enough to run the model give you the most beautiful images. This enables so many people to take part. And by the way, if you want the 3090, I'm giving away one of them. Hey, it's Yannick from the future quick addendum. It's actually a 3090 Ti, not just a 3090. So even better. All right, back to me in the past, not only one, I'm giving away one that's signed by Jensen Huang, the CEO of Nvidia, all you got to do to take part is stay until the end of the video, I'll tell you exactly how you can get it. So here's how something like this would work. You go to the hugging face demo, or to the stable diffusion dream studio, and you enter a prompt a bird with a funny hat. Hello to that birds with funny hats. And you know what happens when you release a model to the open when you release software for anyone to just use and adapt great things people almost immediately started improving this thing. Look at that all of a sudden someone figures out how to only use half as much memory. Well, now the model runs on even more devices. Look at that someone built an ONNX exporter. Well, now I can throw it on SageMaker throw it into a Triton server. People are writing tutorials how to run the model locally and in a collab. Oh, look at that. It's a little tool to make a collage. Picture one, picture two, picture three, and the overlapping regions will just match. Look at that in painting. Amazing. Oh, what it's an anime series about Oprah in Kyoto. And look, people are figuring out how to run it on an M1 max GPU. No wait, people are figuring out how to run it on an M2 in less than 30 seconds. Look at this stuff. This is created on a laptop. Incredible. Oh, I guess we're doing videos now. Look, here's a bunch of bubbles and formulas. All right, biomorphic video. This is certainly trippy. The Mento Mori video consistency, different styles looks amazing. Oh, look, there's a hugging face space called diffuse the rest. What do you do? You draw something. Look at that. All right, house, house. Diffuse the rest. Look at that house. Nice house, house, house, house. And the biomorphic thing is still going. And this enables so much look here. Children's drawing, cool art, children's drawing, cool art, children's drawing, cool art. Look at that. Squirrel, squirrel, dragon, dragon. But you see what's happening here, people are taking this and they're making all kinds of stuff. They're improving it in various ways. And they are infinitely creative. This is an explosion of creativity. All of a sudden, you don't need the skills of a painter anymore. You don't need Photoshop skills or anything like that. Look at that. It's lexica. It's a search engine where you can search through previously generated images along with their prompts. Look at this stuff. This is so cool. And it's all accessible. It's all available. And people are becoming so good at prompting these models. Look at this one. This essentially has a few of the prompt tricks like stunning, gorgeous, much detail, much wow. But the actual content of the picture is just a bunch of emojis, a burger, a bunch of houses, a tiger fountain Harry Styles as a manga cover. And this is just the beginning people are making web UIs for the model. You remember how Dali proudly presented the fact that you could make variations of images using their API, you can do that too. It's a simple radio app away. Look at that input image, submit, get your variations. Absolutely crazy. You remember clip guided diffusion? Well, how about clip guided stable diffusion, bear holding a lollipop over the rooftop of Hong Kong looking at a UFO. Oh look hugging face has a library called diffusers. Oh look stable diffusion is now in diffusers. Dad, why is my sister's name Rose because your mother loves roses. Thanks Dad. No problem. Stable diffusion evolution of the typical American living room from 1950 to 2040. According to stable diffusion. Look at that 50s, 60s, 70s. Tell me this is not crazy. Look stable diffusion is now in mid journey and the quality is so good. Oh what people are building Photoshop plugins. Look at that in paint out paint paint around. Well, this seems pretty cool too. Don't know what it is, but pretty nice. This is what happens when you give people the opportunity and the tools to build when you give them access when you give them the freedom to make what they want. They make absolutely great things. This thing here, it's an alternative web UI. Well, why only rely on one company making a web UI? Why not give users the option then choose the best models are so good and versatile. Look at this stuff. It's amazing. I don't know what this is, but nice. So people are experimenting with this stuff, figuring out what's going on right here, which parameters do what lots of investigation into the model because it's just accessible. There's entire notebooks just trying to figure out what the individual parts of the model do, how you change stuff, what happens when you change stuff. Not only do people build great things around the model, people also understand the model much better and therefore are able to push it to improve it in a much greater speed. This one's called visual grounding guided in painting. So up here you have an astronaut, you say the part that you want to replace helmet, what do you want to replace it with flower and I mean, it's not exactly only the helmet, but you can see where this is going. These are just the first iterations of an entire age that we are about to begin. Note how crazy this is just a combination of two or three of these models made it such that I don't even have to click anywhere in the image. I can just interact with these things via text via just natural language. How many people does this make art and design and in general creative endeavors accessible to? Oh wow, it's Jeff Lonzucker Gates. Look at all the variations of things that are in there. This is crazy. Now, as I said, we're only at the start and people are improving this day by day by day. One improvement that I would specifically like to highlight is called textual inversion. Textual inversion is a technique where you take a bunch of images like a very few images, five images, 10 images of a thing and you tell, you teach the model about that thing. And once you've done that, the model kind of knows the concept of that thing and can then make new generations according to the thing. So here's what I mean. For example, here you give it a bunch of images of a yoga pose and you teach the model that this is kind of a new concept. You can give it a name. In this case, they call it S star because you know, if you could use any name in the world, obviously would choose S star as a name. In any case, now you can give this S star to the model along with a prompt and the model will create images according to that concept. So this is a great way to teach this model new things that it didn't know about. You can't do it with every and anything, but you can sort of teach it a concept and look textual inversion is already in hugging face diffusers. And look, there's already a library of pre made things that people have taught the stable diffusion model. So all of these things are concepts that people have previously ran textual inversion on. And therefore you can simply take these concepts and generate images according to these concepts. Super Mario World map. Yeah, let's use that. Switzerland, S and W map. Not exactly, but this is my very first try. So we'll get there. Now about a week after the release of stable diffusion, OpenAI released a blog post that they're now introducing outpainting to their Dali API. Dali being the model that they've trained, they have behind their API, they let you interact with it if you are on the beta users list. So now you can take a picture and you can sort of outpaint from it, generate surroundings of that picture, according to Dali. I guess what instead of waiting for OpenAI to build this into their API with stable diffusion, someone can just go and make it someone just take the model and build a little UI that does outpainting. Look at that. Give it a prompt, click. There's a window. There's a girl. Now I can't say whether this is in response to stable diffusion or just by accident, but OpenAI also updated their pricing recently to make it significantly cheaper to use their text API's. Now Dali the image generator is still in beta, but also there they now have a commercial model. So for 115 generations, you're paying $15. But therefore you're allowed to commercialize the images that you get out of Dali. As you can see right here in the official UI of stable diffusion, the one from stability AI, an image cost one credit, one credit is one cent that's over 10 times cheaper than Dali. And keep in mind, you can just download the model and run it yourself, although I'm pretty sure like the electricity is going to cost more than a cent per image and stable diffusion images that you make, obviously, you're able to commercialize those from the day it was publicly released. The battle between the API model of OpenAI and the open model of stability doesn't end there. OpenAI has recently announced they are now reducing bias and improving safety in Dali to they released a blog post where they say they're implementing a new technique so that the lead generate images of people that more accurately reflect the diversity of the world's population. They simply say a new technique and they give an example when they search for a photo of a CEO rather generate the photo of a CEO, you see it's just men and with their new technique, it is a rainbow of people of different ethnicities and genders and so on. Now again, they don't say what the new technique is, but people were wondering because it's not that easy to mitigate this kind of stuff. Now people found that there are some rather interesting side effects of this. For example, if they generate a professional DSLR color photograph of British soldiers during the American Revolution, it seems to be, let's say historically rather inaccurate. And now it shows again how creative people are. So in order to figure out what's running since we can't expect the code, people came up with the idea, maybe they're just kind of modifying your prompt. So people entered as a prompt the sentence a person holding a sign that says like that's the prompt and what comes out this picture gets out of that other people have reproduced this the prompt here says pixel art of a person holding a text sign that says and the picture is that so it turns out that the technique that open AI is advertising is they simply have like a predefined list of things and they append these things to your prompt thereby potentially completely destroying your prompt but neither would they say what the technique is nor do they let you opt out of the technique like in the name of safety they don't trust you they can't just say you know we actually found that this pretty simple thing mitigates a lot of the bias if you just append these kind of words to the prompt then it actually works pretty well you'll get a pretty diverse result if you want to do so take it under consideration use it in our API we even made like a button for you to automatically append these words this would have been so much better than them just saying we have a new technique and no we're not gonna let you opt out of the technique whenever you enter a prompt that says beautiful summer morning a person meditates on the top of Mount Fuji watching the calm sunset the birds fly across the river and the air is so pure in this blue nice sky Hindu elderly man it is as I say a philosophy it is we know what's good for you overheard in Silicon Valley safety safety safety open source on the other hand stability AI is partnering up with institutions around the world to make localized models of stable diffusion that seems to be much more sensible to get sort of all of the world to participate you go to places and you let people there improve the model make their own models so at the end it works for those people too but oh man it did not take long for people to not be happy about this at all simply giving people the tools and opportunity to be creative that doesn't sit well with some people Kotaku writes AI creating art is an ethical and copyright nightmare tech crunch writes this startup is setting a dolly to like AI free consequences be damned you mean the consequences that anyone has the ability to make their own stuff oh yeah those be damned rather we write a hit piece on people but the same author at the same publication wasn't quite satisfied so about 10 days later another article deep fakes for all uncensored AI art model prompts ethics questions wow really two articles two hit pieces gotta milk it gotta milk those ethical questions that are raised right but don't worry the exact same author writes pieces such as rephrase AI lands fresh investment to grow its synthetic media platform in a quite positive piece about a company that makes synthetic media gee synthetic media like image and video generation i wonder what's the difference oh right this one is actually controlled behind an API can be sold and can be controlled by just having one or two people at the correct places in a large company or in the app store or in the play store or in the appropriate journalistic channels right here's another one win.ai launches out of stealth with an AI assistant for sales calls oh wait an AI assistant for sales calls like you know like a bot that makes sales calls for you know salespeople like the most annoying calls you'll ever get and now it's an AI doing it for them i guess at least you can now swear at them without you having to feel bad for them or something like this again also completely positive coverage i don't know the model that can make Oprah Winfrey as an anime that's the problem consequences be damned and of course the AI ethics community isn't happy at all because what's ethical about giving people access to tools and and giving them the opportunity to make great things that's terrible you can always just pull one of like five different standard insults from the drawer and just accuse anyone that you don't like of one of these when you've got n engineers cheerfully putting out models they know to be racist you've got a company with n racists you hear that stability i that's all of you that's that's all of you that's it that's what it means and everyone taking part in it we need organizations like hugging face who is hosting stable diffusion for public download to act with courage and bring their might to the firefighting effort and addressing a mutt must act directly if these scholars are nobody to you you are not qualified to work in this space well that's the thing about stuff being open and stuff being a free market he doesn't need to be qualified he can just do it it's fine but it's very clear what's going on some people enjoy the level of power that they have in big organizations if there is just a few big organizations a few big machine learning conferences a few publications then you have a pretty solid grasp on power you can make noise on twitter and you make sure that whatever happens needs to go through one of those people at least to get approval distributing an open model to anyone where anyone can improve anyone can do their thing and build their stuff in a decentralized fashion means that power vanishes no one has to ask specifically any one person anymore whether they're allowed to do something whether something is ethical in their view or not i can't believe stable diffusion is out there for public use and that's considered as okay yes yes that's okay now as you can see the pressure on hugging face of these people is getting pretty intense because how dare they just give something to people well here is what a member of their ethics team has to say i'm concerned about these things being over statements that function to give an impression that the release is something that ethics minded ai people at least at hugging face signed off on we do not and did not sign off on anything we advise within an open source community that means we are working on licensing documentation and release strategies which any contributor can take or leave we are a resource not approvers really really i i i recall i recall that was quite different a few months ago the evolution of centralized ai ethics don't be evil we decide what is evil we decide you are evil but what are they actually saying right here well you know if you have this model you could make any image that you want any image you could make a bad image like essentially they're saying like okay wait essentially there's essentially what they're saying is like this pen this pen right here the fact that you can buy it in the store is terrible because you know what someone could do you know you know someone could could like someone could could could could someone could someone could write a dirty word with it but all that being said please let me know what you think there is absolutely issues around things like copyright here maybe we need a new social contract like you as an artist obviously put in a lot of work into making these images is it okay if then the machine simply grabs them into the training data set obviously it's okay for humans to be inspired by other pictures but in the world where machines can consume and produce millions and billions of images it tends to be a bit of a different story so maybe society needs to evolve a little bit right there nevertheless i feel the explosion of creativity is great people are infinitely creative with these things and that is just such a good thing overall and the fact that someone can use it to make a nasty picture or the fact that it doesn't work for all kinds of pictures exactly the same to me is just such a non-starter and it seems to be quite an dishonest argument that is just aimed at further centralization of power some people just don't like that things are available to the public to anyone without having to ask them first if something is okay i'm not hating on open ai or things like this who decide to put their models behind an api but don't at the same time talk about democratizing ai like it's completely cool you train a cool model you asked for money for people to use it that's fine but this is democratizing ai democratizing means giving people access to everything allowing people to take things for themselves make it better and give back to the community the explosion of applications is absolutely great that we've seen look at this this tool creates a color palette from a text nobody nobody at open ai came up with this i'm fairly sure this is such a unique application but such a great thing you give a bunch of words you get a color palette out how awesome is that and that's and that's what happens when you give people the tools and access and freedom and even better when the model runs on a consumer gpu so anyone can use it hello it's me from the editing room there's so much stuff coming out i really thought this should make this video but it appeared literally today so or i saw it today this is dream textures which is an endless texture generator in blender directly in blender using stable diffusion to create unique and seamless textures this is a playlist of stable diffusion tutorials on youtube this is charlie which is an app that will bring stable diffusion onto an m1 or m2 mac in a single click and this is stable diffusion implemented using tensorflow and caros by diva gupta props to diva for implementing this i hear this is a serious effort not to be joked about all right back to me in the past but as i said let me know what you think all right just a few things that might be helpful to you then the video is over deep garg on twitter announces the first ever transformer seminar by stanford this is a seminar called transformers united and all the lectures are on youtube so if you want to know something about transformers from an academic perspective place to go another thing because it just starts like yesterday is the shifts challenge 2022 which evaluates robustness and uncertainty on real world data projects include things like white matter multiple sclerosis segmentation or marine cargo vessel power estimation so this is real world data and you have to act under uncertainty and distribution shifts and it's a challenge so if you're into challenges this one's starting right now all right so now i'm gonna tell you how you enter the raffle for the gpu this video is kindly sponsored by nvidia specifically they want you to know about the gtc 2022 fall edition gtc is nvidia's developer conference the one of the largest of its kind it's free to attend and it's full with amazing content of course the keynote by jensen huang is the biggest event and jensen's going to tell you all about the future plans of nvidia and what's happening in the world of deep learning gpu computing and everything around it now with nvidia being the market leader that it is i'd say that's a pretty cool thing to attend now of course the focus are going to be things like more efficient deep learning but also things like the metaverse vr and collaborations such as this one nvidia and semen's partner up to enable what they call the industrial multiverse so this connects nvidia's omniverse platform which is essentially a virtual reality platform to simulate the real world as closely as possible in order to design to train and to make forecasts this is being connected to the semen's accelerator which semen's being the hardware and sensor company that it is is a platform for iot enabled hardware and software so you can imagine that as more and more of these companies pair up their systems and team up we're going to get a richer and richer digital and real hybrid world i think this comes pretty close to the vision that mark zuckerberg had for the metaverse and i'd say in many ways closer than you know strapping on a vr headset and running around in vr chat so it's pretty cool to see the industrial applications of this gtc is going to be full with unique demos and workshops that you can attend and of course a lot of talks now next to the keynote there's also a fireside chat with the touring award winners they are all going to be there jan lecan jeffrey hinton yosha ben joe and for a full hour they'll share their opinions about the current state and future of ai research okay here is how you get into the raffle for the gpu go to y culture.com slash gtc now it's important that you sign up to gtc using my link this will track you in their system but once you've done that it's not enough you actually need to attend gtc well i obviously suggest you attend the keynote but you can attend any session but it needs to be at least one session that you attend of the gtc conference once you've done that you'll be entered into the raffle for the gpu i'll notify the winner as soon as i know now there's one caveat this only counts for people in emia europe the middle east and africa if you happen to live there great enter the raffle if you don't live there i'm sorry i don't have power over this but what i can do is i can raffle out a bunch of merch such as shirts like these so if you don't live in emia you can enter the raffle there and maybe get a shirt or whatever you want essentially so in any case the link is y culture.com slash gtc and even if you do not live in emia if you enter into the raffle it'd be absolutely great if you still attend the developer conference as long as you sign up using the link they'll still be able to track you and that gives me brownie points with nvidia so again why culture.com slash gtc sign up to the conference using that link attend at least one session you'll be entered into the raffle automatically all right that was it thank you so much in video for sponsoring this video i'll see you at the gtc conference or in the next video bye bye what fun i was gonna write fun what did you think
 Stable Diffusion has been released to the public and the world is creative as never before. It's
 an explosion of creativity, collaboration and open improvement. But not everyone is happy.
 Today we'll look at how Stable Diffusion works, how it impacts the world and what people say
 about it. Welcome to a special edition of ML News.
 Remember, Emma Stuck, who I had as an interview guest here on the channel,
 the founder of stability AI has announced on August 22, the public open source release of
 Stable Diffusion. Stable Diffusion is a text to image model, you give it a piece of text,
 and it makes an image and the images it creates are stunning. This image right here, these images
 are created by Stable Diffusion. This is not Photoshop, this doesn't just adjust a little bit
 an existing image, it creates images from pure text. So the cool thing about Stable Diffusion is
 that while similar models have been just available behind an API like open AI's dali, this is
 completely in the open, you can just download the model and do whatever you want with it. A small
 point, there is actually a license on it, but it's very permissive. So almost whatever you want.
 Specifically, you can change it, you can update it, you can monetize it, and all of that stuff.
 It's been trained on a subset of the lion 5b data set that's been filtered for specifically
 aesthetically pleasing images. And that is a big part of why the results are so amazing.
 And the craziest thing about all of this is this model does not need a data center to run,
 it can actually run on a single GPU. Look, this thing right here is enough to run the model
 give you the most beautiful images. This enables so many people to take part. And by the way,
 if you want the 3090, I'm giving away one of them. Hey, it's Yannick from the future quick
 addendum. It's actually a 3090 Ti, not just a 3090. So even better. All right, back to me in the
 past, not only one, I'm giving away one that's signed by Jensen Huang, the CEO of Nvidia, all
 you got to do to take part is stay until the end of the video, I'll tell you exactly how you can
 get it. So here's how something like this would work. You go to the hugging face demo, or to the
 stable diffusion dream studio, and you enter a prompt a bird with a funny hat. Hello to that
 birds with funny hats. And you know what happens when you release a model to the open when you
 release software for anyone to just use and adapt great things people almost immediately started
 improving this thing. Look at that all of a sudden someone figures out how to only use half as much
 memory. Well, now the model runs on even more devices. Look at that someone built an ONNX
 exporter. Well, now I can throw it on SageMaker throw it into a Triton server. People are writing
 tutorials how to run the model locally and in a collab. Oh, look at that. It's a little tool to
 make a collage. Picture one, picture two, picture three, and the overlapping regions will just match.
 Look at that in painting. Amazing. Oh, what it's an anime series about Oprah in Kyoto. And look,
 people are figuring out how to run it on an M1 max GPU. No wait, people are figuring out how to run
 it on an M2 in less than 30 seconds. Look at this stuff. This is created on a laptop. Incredible. Oh,
 I guess we're doing videos now. Look, here's a bunch of bubbles and formulas. All right,
 biomorphic video. This is certainly trippy. The Mento Mori video consistency, different styles
 looks amazing. Oh, look, there's a hugging face space called diffuse the rest. What do you do?
 You draw something. Look at that. All right, house, house. Diffuse the rest. Look at that house. Nice
 house, house, house, house. And the biomorphic thing is still going. And this enables so much
 look here. Children's drawing, cool art, children's drawing, cool art, children's drawing,
 cool art. Look at that. Squirrel, squirrel, dragon, dragon. But you see what's happening here,
 people are taking this and they're making all kinds of stuff. They're improving it in various
 ways. And they are infinitely creative. This is an explosion of creativity. All of a sudden,
 you don't need the skills of a painter anymore. You don't need Photoshop skills or anything like
 that. Look at that. It's lexica. It's a search engine where you can search through previously
 generated images along with their prompts. Look at this stuff. This is so cool. And it's all
 accessible. It's all available. And people are becoming so good at prompting these models. Look
 at this one. This essentially has a few of the prompt tricks like stunning, gorgeous, much detail,
 much wow. But the actual content of the picture is just a bunch of emojis, a burger, a bunch of
 houses, a tiger fountain Harry Styles as a manga cover. And this is just the beginning people are
 making web UIs for the model. You remember how Dali proudly presented the fact that you could
 make variations of images using their API, you can do that too. It's a simple radio app away.
 Look at that input image, submit, get your variations. Absolutely crazy. You remember
 clip guided diffusion? Well, how about clip guided stable diffusion, bear holding a lollipop over the
 rooftop of Hong Kong looking at a UFO. Oh look hugging face has a library called diffusers. Oh
 look stable diffusion is now in diffusers. Dad, why is my sister's name Rose because your mother
 loves roses. Thanks Dad. No problem. Stable diffusion evolution of the typical American
 living room from 1950 to 2040. According to stable diffusion. Look at that 50s, 60s, 70s.
 Tell me this is not crazy. Look stable diffusion is now in mid journey and the quality is so
 good. Oh what people are building Photoshop plugins. Look at that in paint out paint paint around.
 Well, this seems pretty cool too. Don't know what it is, but pretty nice. This is what happens when
 you give people the opportunity and the tools to build when you give them access when you give them
 the freedom to make what they want. They make absolutely great things. This thing here,
 it's an alternative web UI. Well, why only rely on one company making a web UI? Why not give users
 the option then choose the best models are so good and versatile. Look at this stuff. It's amazing.
 I don't know what this is, but nice. So people are experimenting with this stuff, figuring out
 what's going on right here, which parameters do what lots of investigation into the model
 because it's just accessible. There's entire notebooks just trying to figure out what the
 individual parts of the model do, how you change stuff, what happens when you change stuff. Not
 only do people build great things around the model, people also understand the model much better and
 therefore are able to push it to improve it in a much greater speed. This one's called visual
 grounding guided in painting. So up here you have an astronaut, you say the part that you want to
 replace helmet, what do you want to replace it with flower and I mean, it's not exactly only
 the helmet, but you can see where this is going. These are just the first iterations of an entire
 age that we are about to begin. Note how crazy this is just a combination of two or three of
 these models made it such that I don't even have to click anywhere in the image. I can just interact
 with these things via text via just natural language. How many people does this make art
 and design and in general creative endeavors accessible to? Oh wow, it's Jeff Lonzucker Gates.
 Look at all the variations of things that are in there. This is crazy. Now, as I said, we're only
 at the start and people are improving this day by day by day. One improvement that I would
 specifically like to highlight is called textual inversion. Textual inversion is a technique where
 you take a bunch of images like a very few images, five images, 10 images of a thing and you tell,
 you teach the model about that thing. And once you've done that, the model kind of knows the
 concept of that thing and can then make new generations according to the thing. So here's
 what I mean. For example, here you give it a bunch of images of a yoga pose and you teach the model
 that this is kind of a new concept. You can give it a name. In this case, they call it S star because
 you know, if you could use any name in the world, obviously would choose S star as a name. In any
 case, now you can give this S star to the model along with a prompt and the model will create
 images according to that concept. So this is a great way to teach this model new things that
 it didn't know about. You can't do it with every and anything, but you can sort of teach it a concept
 and look textual inversion is already in hugging face diffusers. And look, there's already a
 library of pre made things that people have taught the stable diffusion model. So all of these things
 are concepts that people have previously ran textual inversion on. And therefore you can simply
 take these concepts and generate images according to these concepts. Super Mario World map. Yeah,
 let's use that. Switzerland, S and W map. Not exactly, but this is my very first try. So
 we'll get there. Now about a week after the release of stable diffusion, OpenAI released a
 blog post that they're now introducing outpainting to their Dali API. Dali being the model that
 they've trained, they have behind their API, they let you interact with it if you are on the beta
 users list. So now you can take a picture and you can sort of outpaint from it, generate surroundings
 of that picture, according to Dali. I guess what instead of waiting for OpenAI to build this into
 their API with stable diffusion, someone can just go and make it someone just take the model and
 build a little UI that does outpainting. Look at that. Give it a prompt, click. There's a window.
 There's a girl. Now I can't say whether this is in response to stable diffusion or just by accident,
 but OpenAI also updated their pricing recently to make it significantly cheaper to use their text
 API's. Now Dali the image generator is still in beta, but also there they now have a commercial
 model. So for 115 generations, you're paying $15. But therefore you're allowed to commercialize the
 images that you get out of Dali. As you can see right here in the official UI of stable diffusion,
 the one from stability AI, an image cost one credit, one credit is one cent that's over 10
 times cheaper than Dali. And keep in mind, you can just download the model and run it yourself,
 although I'm pretty sure like the electricity is going to cost more than a cent per image and
 stable diffusion images that you make, obviously, you're able to commercialize those from the day
 it was publicly released. The battle between the API model of OpenAI and the open model of stability
 doesn't end there. OpenAI has recently announced they are now reducing bias and improving safety
 in Dali to they released a blog post where they say they're implementing a new technique so that
 the lead generate images of people that more accurately reflect the diversity of the world's
 population. They simply say a new technique and they give an example when they search for a photo
 of a CEO rather generate the photo of a CEO, you see it's just men and with their new technique,
 it is a rainbow of people of different ethnicities and genders and so on. Now again,
 they don't say what the new technique is, but people were wondering because it's not
 that easy to mitigate this kind of stuff. Now people found that there are some rather
 interesting side effects of this. For example, if they generate a professional DSLR color photograph
 of British soldiers during the American Revolution, it seems to be, let's say historically rather
 inaccurate. And now it shows again how creative people are. So in order to figure out what's
 running since we can't expect the code, people came up with the idea, maybe they're just kind of
 modifying your prompt. So people entered as a prompt the sentence a person holding a sign that
 says like that's the prompt and what comes out this picture gets out of that other people have
 reproduced this the prompt here says pixel art of a person holding a text sign that says and the
 picture is that so it turns out that the technique that open AI is advertising is they simply have
 like a predefined list of things and they append these things to your prompt thereby potentially
 completely destroying your prompt but neither would they say what the technique is nor do they
 let you opt out of the technique like in the name of safety they don't trust you they can't just say
 you know we actually found that this pretty simple thing mitigates a lot of the bias if you just
 append these kind of words to the prompt then it actually works pretty well you'll get a pretty
 diverse result if you want to do so take it under consideration use it in our API we even made like
 a button for you to automatically append these words this would have been so much better than
 them just saying we have a new technique and no we're not gonna let you opt out of the technique
 whenever you enter a prompt that says beautiful summer morning a person meditates on the top of
 Mount Fuji watching the calm sunset the birds fly across the river and the air is so pure in this
 blue nice sky Hindu elderly man it is as I say a philosophy it is we know what's good for you
 overheard in Silicon Valley safety safety safety open source on the other hand stability AI is
 partnering up with institutions around the world to make localized models of stable diffusion
 that seems to be much more sensible to get sort of all of the world to participate you go to places
 and you let people there improve the model make their own models so at the end it works for those
 people too but oh man it did not take long for people to not be happy about this at all simply
 giving people the tools and opportunity to be creative that doesn't sit well with some people
 Kotaku writes AI creating art is an ethical and copyright nightmare tech crunch writes this startup
 is setting a dolly to like AI free consequences be damned you mean the consequences that anyone
 has the ability to make their own stuff oh yeah those be damned rather we write a hit piece on
 people but the same author at the same publication wasn't quite satisfied so about 10 days later
 another article deep fakes for all uncensored AI art model prompts ethics questions wow really
 two articles two hit pieces gotta milk it gotta milk those ethical questions that are raised right
 but don't worry the exact same author writes pieces such as rephrase AI lands fresh investment
 to grow its synthetic media platform in a quite positive piece about a company that makes synthetic
 media gee synthetic media like image and video generation i wonder what's the difference oh right
 this one is actually controlled behind an API can be sold and can be controlled by just having one
 or two people at the correct places in a large company or in the app store or in the play store
 or in the appropriate journalistic channels right here's another one win.ai launches out of stealth
 with an AI assistant for sales calls oh wait an AI assistant for sales calls like you know like a
 bot that makes sales calls for you know salespeople like the most annoying calls you'll ever get and
 now it's an AI doing it for them i guess at least you can now swear at them without you having to
 feel bad for them or something like this again also completely positive coverage i don't know
 the model that can make Oprah Winfrey as an anime that's the problem consequences be damned and of
 course the AI ethics community isn't happy at all because what's ethical about giving people access
 to tools and and giving them the opportunity to make great things that's terrible you can always
 just pull one of like five different standard insults from the drawer and just accuse anyone
 that you don't like of one of these when you've got n engineers cheerfully putting out models they
 know to be racist you've got a company with n racists you hear that stability i that's all of
 you that's that's all of you that's it that's what it means and everyone taking part in it
 we need organizations like hugging face who is hosting stable diffusion for public download
 to act with courage and bring their might to the firefighting effort and addressing
 a mutt must act directly if these scholars are nobody to you you are not qualified to work in
 this space well that's the thing about stuff being open and stuff being a free market he doesn't need
 to be qualified he can just do it it's fine but it's very clear what's going on some people enjoy
 the level of power that they have in big organizations if there is just a few big
 organizations a few big machine learning conferences a few publications then you have a pretty solid
 grasp on power you can make noise on twitter and you make sure that whatever happens needs to go
 through one of those people at least to get approval distributing an open model to anyone
 where anyone can improve anyone can do their thing and build their stuff in a decentralized fashion
 means that power vanishes no one has to ask specifically any one person anymore whether
 they're allowed to do something whether something is ethical in their view or not i can't believe
 stable diffusion is out there for public use and that's considered as okay yes yes that's okay now
 as you can see the pressure on hugging face of these people is getting pretty intense because
 how dare they just give something to people well here is what a member of their ethics team has
 to say i'm concerned about these things being over statements that function to give an impression
 that the release is something that ethics minded ai people at least at hugging face signed off on
 we do not and did not sign off on anything we advise within an open source community that means
 we are working on licensing documentation and release strategies which any contributor can take
 or leave we are a resource not approvers really really i i i recall i recall that was quite
 different a few months ago the evolution of centralized ai ethics don't be evil we decide
 what is evil we decide you are evil but what are they actually saying right here well you know if
 you have this model you could make any image that you want any image you could make a bad image like
 essentially they're saying like okay wait essentially there's essentially what they're
 saying is like this pen this pen right here the fact that you can buy it in the store is terrible
 because you know what someone could do you know you know someone could could like someone could
 could could could someone could someone could write a dirty word with it but all that being said
 please let me know what you think there is absolutely issues around things like copyright
 here maybe we need a new social contract like you as an artist obviously put in a lot of work into
 making these images is it okay if then the machine simply grabs them into the training data set
 obviously it's okay for humans to be inspired by other pictures but in the world where machines can
 consume and produce millions and billions of images it tends to be a bit of a different story
 so maybe society needs to evolve a little bit right there nevertheless i feel the explosion of
 creativity is great people are infinitely creative with these things and that is just such a good
 thing overall and the fact that someone can use it to make a nasty picture or the fact that it
 doesn't work for all kinds of pictures exactly the same to me is just such a non-starter and it seems
 to be quite an dishonest argument that is just aimed at further centralization of power some
 people just don't like that things are available to the public to anyone without having to ask them
 first if something is okay i'm not hating on open ai or things like this who decide to put their
 models behind an api but don't at the same time talk about democratizing ai like it's completely
 cool you train a cool model you asked for money for people to use it that's fine but this is
 democratizing ai democratizing means giving people access to everything allowing people to take things
 for themselves make it better and give back to the community the explosion of applications is
 absolutely great that we've seen look at this this tool creates a color palette from a text nobody
 nobody at open ai came up with this i'm fairly sure this is such a unique application but such a
 great thing you give a bunch of words you get a color palette out how awesome is that and that's
 and that's what happens when you give people the tools and access and freedom and even better when
 the model runs on a consumer gpu so anyone can use it hello it's me from the editing room there's so
 much stuff coming out i really thought this should make this video but it appeared literally today
 so or i saw it today this is dream textures which is an endless texture generator in blender
 directly in blender using stable diffusion to create unique and seamless textures this is a
 playlist of stable diffusion tutorials on youtube this is charlie which is an app that will bring
 stable diffusion onto an m1 or m2 mac in a single click and this is stable diffusion implemented
 using tensorflow and caros by diva gupta props to diva for implementing this i hear this is a
 serious effort not to be joked about all right back to me in the past but as i said let me know
 what you think all right just a few things that might be helpful to you then the video is over
 deep garg on twitter announces the first ever transformer seminar by stanford this is a seminar
 called transformers united and all the lectures are on youtube so if you want to know something
 about transformers from an academic perspective place to go another thing because it just starts
 like yesterday is the shifts challenge 2022 which evaluates robustness and uncertainty on real world
 data projects include things like white matter multiple sclerosis segmentation or marine cargo
 vessel power estimation so this is real world data and you have to act under uncertainty and
 distribution shifts and it's a challenge so if you're into challenges this one's starting
 right now all right so now i'm gonna tell you how you enter the raffle for the gpu this video is
 kindly sponsored by nvidia specifically they want you to know about the gtc 2022 fall edition gtc
 is nvidia's developer conference the one of the largest of its kind it's free to attend and it's
 full with amazing content of course the keynote by jensen huang is the biggest event and jensen's
 going to tell you all about the future plans of nvidia and what's happening in the world of deep
 learning gpu computing and everything around it now with nvidia being the market leader that it is
 i'd say that's a pretty cool thing to attend now of course the focus are going to be things like
 more efficient deep learning but also things like the metaverse vr and collaborations such as this
 one nvidia and semen's partner up to enable what they call the industrial multiverse so this connects
 nvidia's omniverse platform which is essentially a virtual reality platform to simulate the real
 world as closely as possible in order to design to train and to make forecasts this is being
 connected to the semen's accelerator which semen's being the hardware and sensor company that it is
 is a platform for iot enabled hardware and software so you can imagine that as more and more of these
 companies pair up their systems and team up we're going to get a richer and richer digital and real
 hybrid world i think this comes pretty close to the vision that mark zuckerberg had for the metaverse
 and i'd say in many ways closer than you know strapping on a vr headset and running around in
 vr chat so it's pretty cool to see the industrial applications of this gtc is going to be full with
 unique demos and workshops that you can attend and of course a lot of talks now next to the keynote
 there's also a fireside chat with the touring award winners they are all going to be there
 jan lecan jeffrey hinton yosha ben joe and for a full hour they'll share their opinions about
 the current state and future of ai research okay here is how you get into the raffle for the gpu
 go to y culture.com slash gtc now it's important that you sign up to gtc using my link this will
 track you in their system but once you've done that it's not enough you actually need to attend
 gtc well i obviously suggest you attend the keynote but you can attend any session but it needs to be
 at least one session that you attend of the gtc conference once you've done that you'll be entered
 into the raffle for the gpu i'll notify the winner as soon as i know now there's one caveat this only
 counts for people in emia europe the middle east and africa if you happen to live there great enter
 the raffle if you don't live there i'm sorry i don't have power over this but what i can do is i can
 raffle out a bunch of merch such as shirts like these so if you don't live in emia you can enter
 the raffle there and maybe get a shirt or whatever you want essentially so in any case the link is
 y culture.com slash gtc and even if you do not live in emia if you enter into the raffle it'd be
 absolutely great if you still attend the developer conference as long as you sign up using the link
 they'll still be able to track you and that gives me brownie points with nvidia so again
 why culture.com slash gtc sign up to the conference using that link attend at least one session
 you'll be entered into the raffle automatically all right that was it thank you so much in video
 for sponsoring this video i'll see you at the gtc conference or in the next video bye bye
 what fun i was gonna write fun what did you think