 We're with Stevie Batiste and we're in the Applied Sciences Lab here. What are you guys working on? Imagine a day where, you know, in your home one wall is dedicated to being your magic wall. A wall where it can teleport you to another world without really going anywhere. You can have a conversation as richly, as interactively as I am having with you, but at the same time we have this digital augmentation that's happening between us. So, the window of the North Star, it's the vision, it's the long term thing that we want to create because it's the holodeck in some sense. You want to create the holodeck? In some sense this is the holodeck. I think that's great. In order to send this light to each eye, we developed a very unique lens. It's a flat lens and we put it behind an LCD. We replace the backlight of the LCD with a flat lens and we're able to shoot light out into specific locations in space. This is now this, which is again a solid piece of plastic. We have LEDs on the side, light travels around and we're able to shoot that light. I feel like this is going to be like you're going to say, I want you to test this to see that it's solid and then you're going to have an assistant come out and you're going to saw somebody in half. No, no sawing allowed here. And so here we have an array of LEDs. If I want to send light out here, I can just turn this on. This LED is mapped all the way out here. If I want to send light here, I just turn that light on and everything else off. If I put an LCD on top of this and I know where your head is, I'm able to know what light to turn on and thereby I can send an image to a specific location in space and therefore to each eye. So this is the world's only a flat stereoscopic 3D display that's steerable. Have a seat. Okay. This might be hard to take a shoot of. Oh yeah. Jesus. There are two strips of light right there on the left eye and right eye corresponding to each in the middle. I'm going to try to think of the best way to describe what I'm seeing. It is a teapot floating in the middle of a brick room and there are two biplanes flying around the teapot and they're all kind of spinning around in 3D space. And I'm seeing it in 3D in the sense that it physically has depth to my eyes. And as I move my head in and out or left to right, the scene pivots or zooms appropriately as if I were walking into this room and getting closer to the teapot or getting further away from the teapot and everything is kind of moving in a chord. I don't think there's any way this could be captured on camera. It is very weird though I have to say. Now wait a second. Is the teapot reflecting the room? No, reflecting you. It's reflecting what it's seeing. I mean it's reflecting what it would be reflecting in the sense of this room. It's very, this is very odd. We didn't even know this was possible a year ago. Now because we can send an image to each eye and each eye sees basically its own unique image, we can certainly send an image to each person. You see a teapot? I see a skull. Your image is a lot more pleasant than mine. We are in fact finding where you are in space and then shooting a cone of light to each face and you can do that. So Steve if you move your head side to side you can see that those LEDs are in fact following you. Oh they are? It's using the sensor. Using the sensor. So it's lighting up the bits that would make sense to display based on the perspective of the viewer. And what that means is people around you can't see anything. It's like your own private view. Yeah, this would be great for porn. Yeah, exactly. A multiplayer halo. A multiplayer halo. Next we are building a 55 inch version of this. How many years are we away from the magic window? You know that's hard for me to answer. Give me a number. I can't. I wish I could. Five years? I want you to make that assessment by the time I'm done here. Okay what's next? If you want the illusion of looking through a window or a frame you have this function of that the view is changing as a function of your head. Parallax. Parallax. Like this, right? In fact you can see that, that image changing as I move my head left and right. If it was a standard normal display this would only work for one person which is why we need to create a display that is multi-view. Now we need a display that can see your hands in front of it. You can't just put a camera up on top and have it look down because that's just too close to the display. I want to be able to touch the display and even transmit the image of my finger to the other side. As you saw in that video you had the two children almost meeting like this. And that brings a very kind of intimate real contact as if you and I are standing like this and I want to, like that. We're high fiving. That was cool. That was a pretty cool high five. And you can't do that today. You can't do that through any type of technology that we know. Nothing yet. The high five has actually suffered because of digital technology. People are doing fake high fives, they're saying high fives, they're emailing people photos of other people high fiving. What can we do to get a real high five going? So we take the same light guy technology and run it in reverse. So right there we had LED shining into it and projecting light out in the space. Now we're going to put a camera here as it's like your eye was looking down through here which is the camera and we're going to look through the display. And there's my hand. It is an image of my hand through a display while the display is doing its business. This is picking up, the display is picking it up. Let me try this. Let me see. Can I do those things? Yeah, you can. There's a game we wrote to show you that you don't have to touch everything. You don't have to touch a display to interact with it. This is a hover game. And it's not about touching, it's about manipulating this car. Come back next year, I'll even show you some cooler stuff. Well just show it to me now. Let's not wait. Why postpone? Why put off for tomorrow? Because then you won't come back next year. No, I'll come back. We'll leave it. One more level. Okay. Here, even further out. Sticky notes. Sticky notes. Digital sticky notes. Sticky notes are one of the hallmarks when you know something is truly digital, you see it. If there's a sticky note on it, you know you're looking at something digital. Not an analog clock. You need to put a little analog clock on it. This one has the unique capability of not just seeing infrared light, but also visible as well. To show you that we can eventually get to that vision of two people touching each other and giving each other high five. You know, there's no tracking out here. It's all through the display. And that's what the display is able to see. Now I want to take this post-it note. I'm going to put her here and I'm going to let go. This is something that we saw on the new Surface, right? But not quite like this because that, look at that. Right, well that's an actual image. That's an actual image. That's a color reproduction of this. But the new Surface is able to kind of transcribe from that sort of stuff. So I've shown all the pieces all in its own kind of componentized concept. The idea then ultimately is to put them all together to create a more ultimate experience. Well this is incredible. This is awesome. Thank you so much for showing this off. Which part are you selling me? The whole package? We have to do a deal? If you could do a bulk we'd give you a special bulk price. Oh really? A discount? Okay, cool. I'll meet you in the alley later. We should high five, right? Yes. That's a good one.
 We're with Stevie Batiste and we're in the Applied Sciences Lab here.
 What are you guys working on?
 Imagine a day where, you know, in your home one wall is dedicated to being your magic
 wall.
 A wall where it can teleport you to another world without really going anywhere.
 You can have a conversation as richly, as interactively as I am having with you, but
 at the same time we have this digital augmentation that's happening between us.
 So, the window of the North Star, it's the vision, it's the long term thing that we want
 to create because it's the holodeck in some sense.
 You want to create the holodeck?
 In some sense this is the holodeck.
 I think that's great.
 In order to send this light to each eye, we developed a very unique lens.
 It's a flat lens and we put it behind an LCD.
 We replace the backlight of the LCD with a flat lens and we're able to shoot light out
 into specific locations in space.
 This is now this, which is again a solid piece of plastic.
 We have LEDs on the side, light travels around and we're able to shoot that light.
 I feel like this is going to be like you're going to say, I want you to test this to see
 that it's solid and then you're going to have an assistant come out and you're going to
 saw somebody in half.
 No, no sawing allowed here.
 And so here we have an array of LEDs.
 If I want to send light out here, I can just turn this on.
 This LED is mapped all the way out here.
 If I want to send light here, I just turn that light on and everything else off.
 If I put an LCD on top of this and I know where your head is, I'm able to know what
 light to turn on and thereby I can send an image to a specific location in space and
 therefore to each eye.
 So this is the world's only a flat stereoscopic 3D display that's steerable.
 Have a seat.
 Okay.
 This might be hard to take a shoot of.
 Oh yeah.
 Jesus.
 There are two strips of light right there on the left eye and right eye corresponding
 to each in the middle.
 I'm going to try to think of the best way to describe what I'm seeing.
 It is a teapot floating in the middle of a brick room and there are two biplanes flying
 around the teapot and they're all kind of spinning around in 3D space.
 And I'm seeing it in 3D in the sense that it physically has depth to my eyes.
 And as I move my head in and out or left to right, the scene pivots or zooms appropriately
 as if I were walking into this room and getting closer to the teapot or getting further away
 from the teapot and everything is kind of moving in a chord.
 I don't think there's any way this could be captured on camera.
 It is very weird though I have to say.
 Now wait a second.
 Is the teapot reflecting the room?
 No, reflecting you.
 It's reflecting what it's seeing.
 I mean it's reflecting what it would be reflecting in the sense of this room.
 It's very, this is very odd.
 We didn't even know this was possible a year ago.
 Now because we can send an image to each eye and each eye sees basically its own unique
 image, we can certainly send an image to each person.
 You see a teapot?
 I see a skull.
 Your image is a lot more pleasant than mine.
 We are in fact finding where you are in space and then shooting a cone of light to each
 face and you can do that.
 So Steve if you move your head side to side you can see that those LEDs are in fact following
 you.
 Oh they are?
 It's using the sensor.
 Using the sensor.
 So it's lighting up the bits that would make sense to display based on the perspective
 of the viewer.
 And what that means is people around you can't see anything.
 It's like your own private view.
 Yeah, this would be great for porn.
 Yeah, exactly.
 A multiplayer halo.
 A multiplayer halo.
 Next we are building a 55 inch version of this.
 How many years are we away from the magic window?
 You know that's hard for me to answer.
 Give me a number.
 I can't.
 I wish I could.
 Five years?
 I want you to make that assessment by the time I'm done here.
 Okay what's next?
 If you want the illusion of looking through a window or a frame you have this function
 of that the view is changing as a function of your head.
 Parallax.
 Parallax.
 Like this, right?
 In fact you can see that, that image changing as I move my head left and right.
 If it was a standard normal display this would only work for one person which is why we need
 to create a display that is multi-view.
 Now we need a display that can see your hands in front of it.
 You can't just put a camera up on top and have it look down because that's just too
 close to the display.
 I want to be able to touch the display and even transmit the image of my finger to the
 other side.
 As you saw in that video you had the two children almost meeting like this.
 And that brings a very kind of intimate real contact as if you and I are standing like
 this and I want to, like that.
 We're high fiving.
 That was cool.
 That was a pretty cool high five.
 And you can't do that today.
 You can't do that through any type of technology that we know.
 Nothing yet.
 The high five has actually suffered because of digital technology.
 People are doing fake high fives, they're saying high fives, they're emailing people
 photos of other people high fiving.
 What can we do to get a real high five going?
 So we take the same light guy technology and run it in reverse.
 So right there we had LED shining into it and projecting light out in the space.
 Now we're going to put a camera here as it's like your eye was looking down through here
 which is the camera and we're going to look through the display.
 And there's my hand.
 It is an image of my hand through a display while the display is doing its business.
 This is picking up, the display is picking it up.
 Let me try this.
 Let me see.
 Can I do those things?
 Yeah, you can.
 There's a game we wrote to show you that you don't have to touch everything.
 You don't have to touch a display to interact with it.
 This is a hover game.
 And it's not about touching, it's about manipulating this car.
 Come back next year, I'll even show you some cooler stuff.
 Well just show it to me now.
 Let's not wait.
 Why postpone?
 Why put off for tomorrow?
 Because then you won't come back next year.
 No, I'll come back.
 We'll leave it.
 One more level.
 Okay.
 Here, even further out.
 Sticky notes.
 Sticky notes.
 Digital sticky notes.
 Sticky notes are one of the hallmarks when you know something is truly digital, you see
 it.
 If there's a sticky note on it, you know you're looking at something digital.
 Not an analog clock.
 You need to put a little analog clock on it.
 This one has the unique capability of not just seeing infrared light, but also visible
 as well.
 To show you that we can eventually get to that vision of two people touching each other
 and giving each other high five.
 You know, there's no tracking out here.
 It's all through the display.
 And that's what the display is able to see.
 Now I want to take this post-it note.
 I'm going to put her here and I'm going to let go.
 This is something that we saw on the new Surface, right?
 But not quite like this because that, look at that.
 Right, well that's an actual image.
 That's an actual image.
 That's a color reproduction of this.
 But the new Surface is able to kind of transcribe from that sort of stuff.
 So I've shown all the pieces all in its own kind of componentized concept.
 The idea then ultimately is to put them all together to create a more ultimate experience.
 Well this is incredible.
 This is awesome.
 Thank you so much for showing this off.
 Which part are you selling me?
 The whole package?
 We have to do a deal?
 If you could do a bulk we'd give you a special bulk price.
 Oh really?
 A discount?
 Okay, cool.
 I'll meet you in the alley later.
 We should high five, right?
 Yes.
 That's a good one.