 VR is finally happening for real. Facebook's Oculus is coming out next year and it's going to be big. But is Google even in this game? They have this thing called Cardboard that's, well, made out of cardboard and you stick an Android phone in it and you can look around at stuff, you can play in VR. There's people that are doing a lot of really cool stuff with it, but it's mostly just a bunch of little tech demos. So the question I have is, is this for real or is it just an experiment? First of all, not at all an experiment. In a sense, first of all that we have a large team working on cardboard and the things around cardboard. So certainly inside Google, it's not viewed as an experiment. The thing that's important and powerful about cardboard, yes, it's made out of cardboard, but that's also its strength. For a couple bucks, anyone with the computer in their pocket that they already have can have a taste of VR, this kind of bite-sized VR experience. So Google's making a new version, it's announcing this year. And the big deal with this is that it works with larger phones. It can work with phones up to six inches, or work with an iPhone 6 Plus or a Nexus 6. And they also got rid of the magnet and instead it has this crazy little button inside with conductive phone. It actually uses an interior hinge mechanism to, in essence, tap the screen. It kind of moves your finger via some conductive phone inside the cardboard and it's as if you're pushing on the screen. One of the things Google is doing with cardboard is this project called Expeditions. It's this giant cardboard box that's full of these visors and some Nexus phones and a tablet and it lets teachers lead virtual field trips to their classroom. So instead of wheeling in the old VCR and CRT TV, it's a little bit like Magic School Bus. Kids can go on virtual expeditions. You basically can turn any teacher into Miss Frizzle. All right, I am looking at some woods and there's some people standing off. Yeah. And then there's... And if you look to your left, and I can actually see where you're looking here, that is the wave rock. And... This is crazy. Huh. So the wave rock, it's in Perth, Australia. Okay. And it's this rock shaped like a tall, breaking ocean wave. And if you look up... Well, I see there's an arrow in my viewfinder now. That's right. And I've been pointing out one interesting feature of the wave rock. As I move around, the arrow gets less like, hey, stop looking at what you're doing. So what's interesting is these two guys are sort of... So actually, I'm going to stop class for a second. All right. Because it sounded like you were going to ask a question. I was going to ask you a question. Yeah, we're going to come back to class for a second. Since these started at two different spots, they both are looking in the same space, but relatively speaking, they were different positions. So this one saw the hills over here and this one saw it over here. So as a teacher, you're looking at 30 kids, all looking at the same thing, but all like you've got a classroom of like 38 year olds going in totally different directions. It must be hilarious. The footage is wonderful. The reaction you get from students in these classes is if they're there looking up at something going, wow, that's big. Or looking, right, oh my God, we're scuba diving from our classroom. There's something pretty special about it. And so these are actually sandstone formations that have been eroded over many, many thousands of years. Sorry, limestone. So tell me the truth. Do you know all this or do you have a cheat sheet on your tablet that is giving you all this information? I have a cheat sheet. Okay. And in fact, that's one of the features of expeditions we found. The students would never know that you're just reading off- I sound as a teacher, right? Like I've actually been here. That's really important because I think just as a tour guide in the place would know all about that place. When you're the tour guide as the teacher, we want to make sure that you're able to take the class through the things that matter. And of course you could write your own tour as a teacher. Another thing they're doing with VR is they're releasing the specs so that anybody can build their own 360 degree camera with 16 GoPros. It's pretty wild. So the camera has 16 lenses oriented around the circumference of a circle, all looking out. And we use those 16 images, the images from those 16 cameras, we upload those to Google data center. And then we have a set of algorithms which use pretty deep computational photography techniques to, from those 16 images, create on the order of a thousand images. So it's as if you had a thousand cameras instead of 16 around the circumference of the- So you're not just stitching them together, you're actually making like a continuous- Exactly right. So you're not just trying to jam two images together, but instead if you think about, okay, I need to see what the left eye and the right eye would see here, you're taking these two images on the circumference. And then when you're looking here, you're taking these two images and then these two images. And then when you have a thousand images to take from you, you can get a perfectly smooth perceptually accurate in a sense that you have correct uniform stereo and no stitching artifacts throughout the entire sphere. You're in essence creating something from nothing. It's as if you had built a camera made up of a thousand cameras, but of course that would violate the laws of physics. But we've done that in software and the results are really stunning where you can just step into a video into a place and experience it like you're actually there. So how much for 30 seconds of VR footage, how long does it take to process that? I know there's no exact answer, but you guys are throwing a ton of power at it. Yeah. So for 30 seconds of VR footage, well the nice thing is we can always point more computers at it. Google has a few computers, so we can point more computers at it and do it in real time if we want it. We can do it live if we want it. It's just a matter of spinning up more and more computers. So did you catch that bit about Google needing to use its servers to process all of the video from that camera? Those servers are actually a sign. They're a tell that Google has way bigger ambitions in virtual reality than they've let on so far with their little Cardboard projects. So it's a really cool rig, but it requires all this processing power. And while I'm willing to go out and buy a bunch of 16 GoPros, why not create a new kind of super camera that can just do it without having to do all this insane stitching power on the back end? Is that a thing that is even possible? That's a great idea. It's just software and atoms and so on. And one of the many things we're thinking about. So that's Cardboard. The new version works on any size phone, and it'll even work with an iPhone if you can find the apps for it. It's fun, and you can play lots of little games, and you can even take kids on a virtual field trip. But it's obvious that Google has way bigger ambitions. They're not going to let Facebook and HTC and Sony have VR all to themselves. But for now, they're sticking with this, because I think they believe that the best VR is the one you have with you.
 VR is finally happening for real.
 Facebook's Oculus is coming out next year and it's going to be big.
 But is Google even in this game?
 They have this thing called Cardboard that's, well, made out of cardboard and you stick
 an Android phone in it and you can look around at stuff, you can play in VR.
 There's people that are doing a lot of really cool stuff with it, but it's mostly just a
 bunch of little tech demos.
 So the question I have is, is this for real or is it just an experiment?
 First of all, not at all an experiment.
 In a sense, first of all that we have a large team working on cardboard and the things around
 cardboard.
 So certainly inside Google, it's not viewed as an experiment.
 The thing that's important and powerful about cardboard, yes, it's made out of cardboard,
 but that's also its strength.
 For a couple bucks, anyone with the computer in their pocket that they already have can
 have a taste of VR, this kind of bite-sized VR experience.
 So Google's making a new version, it's announcing this year.
 And the big deal with this is that it works with larger phones.
 It can work with phones up to six inches, or work with an iPhone 6 Plus or a Nexus 6.
 And they also got rid of the magnet and instead it has this crazy little button inside with
 conductive phone.
 It actually uses an interior hinge mechanism to, in essence, tap the screen.
 It kind of moves your finger via some conductive phone inside the cardboard and it's as if
 you're pushing on the screen.
 One of the things Google is doing with cardboard is this project called Expeditions.
 It's this giant cardboard box that's full of these visors and some Nexus phones and
 a tablet and it lets teachers lead virtual field trips to their classroom.
 So instead of wheeling in the old VCR and CRT TV, it's a little bit like Magic School
 Bus.
 Kids can go on virtual expeditions.
 You basically can turn any teacher into Miss Frizzle.
 All right, I am looking at some woods and there's some people standing off.
 Yeah.
 And then there's...
 And if you look to your left, and I can actually see where you're looking here, that is the
 wave rock.
 And...
 This is crazy.
 Huh.
 So the wave rock, it's in Perth, Australia.
 Okay.
 And it's this rock shaped like a tall, breaking ocean wave.
 And if you look up...
 Well, I see there's an arrow in my viewfinder now.
 That's right.
 And I've been pointing out one interesting feature of the wave rock.
 As I move around, the arrow gets less like, hey, stop looking at what you're doing.
 So what's interesting is these two guys are sort of...
 So actually, I'm going to stop class for a second.
 All right.
 Because it sounded like you were going to ask a question.
 I was going to ask you a question.
 Yeah, we're going to come back to class for a second.
 Since these started at two different spots, they both are looking in the same space, but
 relatively speaking, they were different positions.
 So this one saw the hills over here and this one saw it over here.
 So as a teacher, you're looking at 30 kids, all looking at the same thing, but all like
 you've got a classroom of like 38 year olds going in totally different directions.
 It must be hilarious.
 The footage is wonderful.
 The reaction you get from students in these classes is if they're there looking up at
 something going, wow, that's big.
 Or looking, right, oh my God, we're scuba diving from our classroom.
 There's something pretty special about it.
 And so these are actually sandstone formations that have been eroded over many, many thousands
 of years.
 Sorry, limestone.
 So tell me the truth.
 Do you know all this or do you have a cheat sheet on your tablet that is giving you all
 this information?
 I have a cheat sheet.
 Okay.
 And in fact, that's one of the features of expeditions we found.
 The students would never know that you're just reading off-
 I sound as a teacher, right?
 Like I've actually been here.
 That's really important because I think just as a tour guide in the place would know all
 about that place.
 When you're the tour guide as the teacher, we want to make sure that you're able to take
 the class through the things that matter.
 And of course you could write your own tour as a teacher.
 Another thing they're doing with VR is they're releasing the specs so that anybody can build
 their own 360 degree camera with 16 GoPros.
 It's pretty wild.
 So the camera has 16 lenses oriented around the circumference of a circle, all looking
 out.
 And we use those 16 images, the images from those 16 cameras, we upload those to Google
 data center.
 And then we have a set of algorithms which use pretty deep computational photography
 techniques to, from those 16 images, create on the order of a thousand images.
 So it's as if you had a thousand cameras instead of 16 around the circumference of the-
 So you're not just stitching them together, you're actually making like a continuous-
 Exactly right.
 So you're not just trying to jam two images together, but instead if you think about,
 okay, I need to see what the left eye and the right eye would see here, you're taking
 these two images on the circumference.
 And then when you're looking here, you're taking these two images and then these two
 images.
 And then when you have a thousand images to take from you, you can get a perfectly smooth
 perceptually accurate in a sense that you have correct uniform stereo and no stitching
 artifacts throughout the entire sphere.
 You're in essence creating something from nothing.
 It's as if you had built a camera made up of a thousand cameras, but of course that
 would violate the laws of physics.
 But we've done that in software and the results are really stunning where you can just step
 into a video into a place and experience it like you're actually there.
 So how much for 30 seconds of VR footage, how long does it take to process that?
 I know there's no exact answer, but you guys are throwing a ton of power at it.
 Yeah.
 So for 30 seconds of VR footage, well the nice thing is we can always point more computers
 at it.
 Google has a few computers, so we can point more computers at it and do it in real time
 if we want it.
 We can do it live if we want it.
 It's just a matter of spinning up more and more computers.
 So did you catch that bit about Google needing to use its servers to process all of the video
 from that camera?
 Those servers are actually a sign.
 They're a tell that Google has way bigger ambitions in virtual reality than they've
 let on so far with their little Cardboard projects.
 So it's a really cool rig, but it requires all this processing power.
 And while I'm willing to go out and buy a bunch of 16 GoPros, why not create a new kind
 of super camera that can just do it without having to do all this insane stitching power
 on the back end?
 Is that a thing that is even possible?
 That's a great idea.
 It's just software and atoms and so on.
 And one of the many things we're thinking about.
 So that's Cardboard.
 The new version works on any size phone, and it'll even work with an iPhone if you can
 find the apps for it.
 It's fun, and you can play lots of little games, and you can even take kids on a virtual
 field trip.
 But it's obvious that Google has way bigger ambitions.
 They're not going to let Facebook and HTC and Sony have VR all to themselves.
 But for now, they're sticking with this, because I think they believe that the best
 VR is the one you have with you.