 So it's basically off the shelf Kinect sensor connected to a PC, Windows 7 PC running the Kinect and Windows software and this is what we can do. I can basically enter a virtual fitting room. So just using my hand I can scan down here on the left. I'm going to slip a tie on, go a bit more formal this morning. Maybe a nice little red number. Drops the tie on and then I'm going to drop down into what's hot for men. Maybe take a briefcase, give myself a little business look going on there. Switch the briefcase between my hands so I can see how it looks from both sides. Maybe put this jacket on over here. So I can get this real sense of trying on clothes in a virtual environment because Kinect can see me, it can see my skeleton, it can map the clothes onto my body. I can do a few other things here. So I'm going to just clear this one out, go for an all in one look. I'm going to slip over here and do my ski day. I'm starting to get into skiing now that I'm in the Pacific Northwest. I have to rock the skiing look and then I can change my location as well. So let me try Scenes, head over here and I can take my skiing look onto the red carpet which isn't quite going to work for Oscars day but you get the idea. So let me show you one more thing, just a quick look at the printing dress. I'm going to go up into what's hot for women and I think over here, there we have the printing dress. So technically you can't try the printing dress on but virtually you can try the printing dress on. So there you go, if I step back we can see the tweets on the surface of the dress. I can go and turn around and see a little bit of how it might look. So the verge really wants to see you wearing a formal gown Tom, that's the idea. There you go, a nice purple number. Nice purple number. Yeah I think that's you, there you go. Maybe step onto the catwalk, onto the red carpet. So go down left hand side, go down into Scenes. And then if you hit the camera above your head it's going to take a snapshot of you, which we're obviously going to post onto Facebook. So the idea here is when David puts his arm into the scene the software is basically saying hang on this is inconsistent, I can see movement relative, the scene is fixed which is what I'm expecting but there's a whole bunch of pixels which are moving all together in fact. So it segments that object, it sees that as a separate object which you can track simultaneously. And you can do that potentially over multiple objects, what you need to do is simultaneously track multiple things, each one of those is assumed to be fairly rigid. What we show in this demo is by tracking, by knowing the position of the hand and of course knowing the position of everything in the background you can enable multi-touch. So when David actually touches anything in the physical scene the system can see that those fingers are now co-located with parts of the scene which were previously scanned in. And then you can even put it in a paint mode so you can do this multi-touch paint on an arbitrary surface, they can be flat surfaces, they can be curved. So what sort of use cases would you expect this to be implemented? Well we've seen a lot of interest in multi-touch, there are certain applications in the way that it's used in phones and slates these days. But we think there's a lot more opportunity for different forms of interaction in different scenarios, so people on a mouse aren't going away for text entry, that's a great combination as it were. But as we start thinking about computers coming into more different application areas, so like in the kitchen when you're busy doing something or wanting to do more ad hoc interactions, so you're in a mobile scenario and you just want to be able to project some content and then interact with it, you're not necessarily predicting onto a plainer surface.
 So it's basically off the shelf Kinect sensor connected to a PC, Windows 7 PC running the
 Kinect and Windows software and this is what we can do. I can basically enter a virtual
 fitting room. So just using my hand I can scan down here on the left. I'm going to slip
 a tie on, go a bit more formal this morning. Maybe a nice little red number. Drops the
 tie on and then I'm going to drop down into what's hot for men. Maybe take a briefcase,
 give myself a little business look going on there. Switch the briefcase between my hands
 so I can see how it looks from both sides. Maybe put this jacket on over here. So I can
 get this real sense of trying on clothes in a virtual environment because Kinect can see
 me, it can see my skeleton, it can map the clothes onto my body. I can do a few other
 things here. So I'm going to just clear this one out, go for an all in one look. I'm going
 to slip over here and do my ski day. I'm starting to get into skiing now that I'm in the Pacific
 Northwest. I have to rock the skiing look and then I can change my location as well.
 So let me try Scenes, head over here and I can take my skiing look onto the red carpet
 which isn't quite going to work for Oscars day but you get the idea. So let me show you
 one more thing, just a quick look at the printing dress. I'm going to go up into what's hot
 for women and I think over here, there we have the printing dress. So technically you
 can't try the printing dress on but virtually you can try the printing dress on. So there
 you go, if I step back we can see the tweets on the surface of the dress. I can go and
 turn around and see a little bit of how it might look. So the verge really wants to see
 you wearing a formal gown Tom, that's the idea. There you go, a nice purple number.
 Nice purple number. Yeah I think that's you, there you go. Maybe step onto the catwalk,
 onto the red carpet. So go down left hand side, go down into Scenes. And then if you
 hit the camera above your head it's going to take a snapshot of you, which we're obviously
 going to post onto Facebook. So the idea here is when David puts his arm into the scene
 the software is basically saying hang on this is inconsistent, I can see movement relative,
 the scene is fixed which is what I'm expecting but there's a whole bunch of pixels which
 are moving all together in fact. So it segments that object, it sees that as a separate object
 which you can track simultaneously. And you can do that potentially over multiple objects,
 what you need to do is simultaneously track multiple things, each one of those is assumed
 to be fairly rigid. What we show in this demo is by tracking, by knowing the position of
 the hand and of course knowing the position of everything in the background you can enable
 multi-touch. So when David actually touches anything in the physical scene the system
 can see that those fingers are now co-located with parts of the scene which were previously
 scanned in. And then you can even put it in a paint mode so you can do this multi-touch
 paint on an arbitrary surface, they can be flat surfaces, they can be curved.
 So what sort of use cases would you expect this to be implemented?
 Well we've seen a lot of interest in multi-touch, there are certain applications in the way
 that it's used in phones and slates these days. But we think there's a lot more opportunity
 for different forms of interaction in different scenarios, so people on a mouse aren't going
 away for text entry, that's a great combination as it were. But as we start thinking about
 computers coming into more different application areas, so like in the kitchen when you're
 busy doing something or wanting to do more ad hoc interactions, so you're in a mobile
 scenario and you just want to be able to project some content and then interact with it, you're
 not necessarily predicting onto a plainer surface.