 For years now, phone manufacturers have been attempting to eliminate, or at least minimize, bezels around the screen. They've tried hole-punch cutouts or even little pop-up cameras to help maximize screen real estate. But a new solution that's gaining popularity is under-display cameras which are completely hidden from view. With them, you could have a perfect, seamless screen with nothing breaking up your screen's image. Or at least, that's the dream. That dream is finally becoming a reality, with three recently released phones using this technology, the Samsung Galaxy Z Fold 3, the Xiaomi Mix 4, and ZTE's Axon 30. The question is, is the trade-off for a notchless phone worth the worst quality of the front-facing camera? The idea itself isn't actually all that new. Companies like Microsoft have been researching under-display cameras for a long time, but until now it hasn't shown up in consumer products like phones. Now, having a screen without a notch or a hole-punch is wonderful, but mainly the area covering the camera was even more distracting than having a notch, and the camera quality was, to put it mildly, pretty awful. But hiding a camera under a phone screen is no easy feat. Stephen Batiste from Microsoft's Applied Sciences team walked us through the technology. It's kind of like looking through a screen door. So like if you're looking through a screen door and you have a camera through the screen door, you can see through it. But as a display gets higher and higher resolution, you've got to think of that screen door becomes more dense and it becomes really hard to see through. And you start losing a lot of light. And not only that, you not only lose a lot of light, you get these things that actually affect where the light goes, like diffraction. So we can put a camera behind a really big display because it's got big pixels, which really means it's got a lot of room that isn't a pixel. But when you get really small displays like you see today in the market, the pixels are really dense. We're talking about like 400 dpi in a lot of cases. So what do you do then? Right? Like that's really that's a really tough screen door to take an image through. The first generation of under display cameras and phones solved this problem by reducing the pixel density in the area covering the camera. This led to less lens obstruction and therefore let more light through to the sensor. But the image quality still paled in comparison to traditional selfie cameras. Not to mention it was very clear where the camera was housed with a distracting low resolution patch. The second generation phones are able to maintain a higher pixel density of around 400 ppi right over their cameras by utilizing a newer wiring technology that allows slightly more light to enter the lens. But even this cut down on nearly 80% of the light that would otherwise be hitting the lens, which still doesn't give great results, especially in low light. So there's always a balance, there's a trade off. You know, you take a camera that potentially might be struggling in a dark environment and you just make it all that harder for them. You know, where do you solve the problem? You do your best on the optics side and eventually I think, you know, the optics will be able to help and the display technology will be able to help and maybe get maybe only 40% of light through rather than 20%, but you're still losing like 60%. And the rest you have to rely on computation. To make up for these optical shortcomings, manufacturers across the board have to use software to compensate for the challenges that still exist with their hardware. So using AI neural networks to do things that cameras and phones do today really well, which is take, you know, snapshots in the dark and they use AI to try to recover as much of the detail that was there. And also at the same time, correct for any artifacts or aberrations caused by that screen door effect. It's kind of a twofold problem. You got to solve it in optics and you got to solve it using computation in the end of the day. But in both ways, you're making it hard on the camera to do a great job in capturing a great image. So the two phones I have here are two devices with more recent generation of this under display camera technology. This is the Xiaomi Mix 4 and this is the ZTE Axon 30. They both have kind of about 400 PPI area covering the screen integrated into the OLED panel. As you can see, like it's pretty difficult to make out, especially with the naked eye. This phones that used under display cameras, they had a kind of rough low pixel density area that honestly I thought looked worse than a notch. It was really distracting. But here, like, especially on this Mix 4, which is a really nice looking phone, I think it looks great. You can barely see the camera under the screen unless you're looking really, really closely, kind of at an angle or on a white background. But generally you can't really see this camera. The problems of course, when you open the cameras themselves and yeah, it's pretty clear just from looking at the live view feed that, you know, these cameras are working with some pretty serious hardware limitations. Like the image is kind of hazy and blown out and it does improve a little bit like after you take a picture. So if I pop it and it, you know, it's still kind of processing, but after it processes, you know, the sharpness and the exposure is improved a little bit, but it's still, you know, it's not the best selfie camera around. For some people who don't care too much about the quality of their selfies or their Zoom calls, maybe it is worth it. But if you do care about image quality with your selfies or if you want to take them in low light, you'll find that the technology really isn't ready yet, at least not for phones. Even experts like Stephen don't know if the trade off is worth it. Customers would look at that and see maybe like, you know, immediate benefit in that there's no notch. But front cameras are also doing many other things like biometric authentication and Windows Hello, and so you have to fit more things in there. And it's up in the air whether you can actually do biometrics behind a screen like that. And so, you know, are you really solving a problem? I'm not sure yet. So I think it's going to be challenging. I also think that sometimes people like to see where the camera is. And so, again, I'm not really sure whether it is. The benefit for the customers, obviously, you have no notch and you potentially have thin bezels at the top and the bottom. That might have some benefit from maybe an aesthetic point of view. But it's really hard to say. I would say in anything like this, there's basically pros and cons and you just have to think through it. And it depends on the product you're trying to build and experience you're trying to deliver. Stephen's team at Microsoft has focused their efforts with on the display cameras on larger video conferencing devices. They aren't set on solving the cosmetic issue of trying to eliminate bezels or notches, but are tackling a very real world problem, helping maintain eye contact over video calls. You know, I was really intent in trying to solve the problem for telepresence. And we've been working in this area for at least 15 years, where we wanted to help bring people together over video conferencing and make it feel like it's real. And one of the problems you want to solve there is to make the window basically like a real window, like I'm talking through you through an actual window rather than a computer screen, which is very two dimensional, doesn't take into account where you're looking, where your position is like in a real window does. And also wanted to do and solve for the cues that were really important in person to person communication like eye contact. We have a number of different research threads around trying to solve the problem, both optically and computationally. And of course, you know, one of the nice applications is okay, putting cameras underneath the display for the purposes of putting the camera where it needs to be to help with eye contact, right? Because if you have the camera where you're looking at it, you are making eye contact. And to also to hide the camera from from the bezel. Now it's important to note that Stephen mentions this tech is only made possible with plastic OLED screens, which explains why you're seeing it in phones first. Most work machines like laptops use LCDs. So it'll still be a minute before under display cameras start to appear in shipping devices. But Microsoft's efforts do show that there are uses for the idea beyond just shrinking phone bezels. Right now it's more of a neat curiosity than anything else. And I definitely don't think you should buy a phone based on this feature alone. These things tend to get better with time though. So who knows? Maybe cameras under the screen will soon be as common as fingerprint sensors. Okay, I have to speak from my personal point of view rather than like from like, you know, like Microsoft product making point of view. My personal point of view, I don't mind the bezels. I think that the bezel is a great place to put technology. And I don't want, you know, me personally, I would like the best front camera possible.
 For years now, phone manufacturers have been attempting to eliminate, or at least minimize,
 bezels around the screen.
 They've tried hole-punch cutouts or even little pop-up cameras to help maximize screen
 real estate.
 But a new solution that's gaining popularity is under-display cameras which are completely
 hidden from view.
 With them, you could have a perfect, seamless screen with nothing breaking up your screen's
 image.
 Or at least, that's the dream.
 That dream is finally becoming a reality, with three recently released phones using
 this technology, the Samsung Galaxy Z Fold 3, the Xiaomi Mix 4, and ZTE's Axon 30.
 The question is, is the trade-off for a notchless phone worth the worst quality of the front-facing
 camera?
 The idea itself isn't actually all that new.
 Companies like Microsoft have been researching under-display cameras for a long time, but
 until now it hasn't shown up in consumer products like phones.
 Now, having a screen without a notch or a hole-punch is wonderful, but mainly the area
 covering the camera was even more distracting than having a notch, and the camera quality
 was, to put it mildly, pretty awful.
 But hiding a camera under a phone screen is no easy feat.
 Stephen Batiste from Microsoft's Applied Sciences team walked us through the technology.
 It's kind of like looking through a screen door.
 So like if you're looking through a screen door and you have a camera through the screen
 door, you can see through it.
 But as a display gets higher and higher resolution, you've got to think of that screen door becomes
 more dense and it becomes really hard to see through.
 And you start losing a lot of light.
 And not only that, you not only lose a lot of light, you get these things that actually
 affect where the light goes, like diffraction.
 So we can put a camera behind a really big display because it's got big pixels, which
 really means it's got a lot of room that isn't a pixel.
 But when you get really small displays like you see today in the market, the pixels are
 really dense.
 We're talking about like 400 dpi in a lot of cases.
 So what do you do then?
 Right?
 Like that's really that's a really tough screen door to take an image through.
 The first generation of under display cameras and phones solved this problem by reducing
 the pixel density in the area covering the camera.
 This led to less lens obstruction and therefore let more light through to the sensor.
 But the image quality still paled in comparison to traditional selfie cameras.
 Not to mention it was very clear where the camera was housed with a distracting low resolution
 patch.
 The second generation phones are able to maintain a higher pixel density of around 400 ppi right
 over their cameras by utilizing a newer wiring technology that allows slightly more light
 to enter the lens.
 But even this cut down on nearly 80% of the light that would otherwise be hitting the
 lens, which still doesn't give great results, especially in low light.
 So there's always a balance, there's a trade off.
 You know, you take a camera that potentially might be struggling in a dark environment
 and you just make it all that harder for them.
 You know, where do you solve the problem?
 You do your best on the optics side and eventually I think, you know, the optics will be able
 to help and the display technology will be able to help and maybe get maybe only 40%
 of light through rather than 20%, but you're still losing like 60%.
 And the rest you have to rely on computation.
 To make up for these optical shortcomings, manufacturers across the board have to use
 software to compensate for the challenges that still exist with their hardware.
 So using AI neural networks to do things that cameras and phones do today really well, which
 is take, you know, snapshots in the dark and they use AI to try to recover as much of the
 detail that was there.
 And also at the same time, correct for any artifacts or aberrations caused by that screen
 door effect.
 It's kind of a twofold problem.
 You got to solve it in optics and you got to solve it using computation in the end of
 the day.
 But in both ways, you're making it hard on the camera to do a great job in capturing
 a great image.
 So the two phones I have here are two devices with more recent generation of this under
 display camera technology.
 This is the Xiaomi Mix 4 and this is the ZTE Axon 30.
 They both have kind of about 400 PPI area covering the screen integrated into the OLED
 panel.
 As you can see, like it's pretty difficult to make out, especially with the naked eye.
 This phones that used under display cameras, they had a kind of rough low pixel density
 area that honestly I thought looked worse than a notch.
 It was really distracting.
 But here, like, especially on this Mix 4, which is a really nice looking phone, I think
 it looks great.
 You can barely see the camera under the screen unless you're looking really, really closely,
 kind of at an angle or on a white background.
 But generally you can't really see this camera.
 The problems of course, when you open the cameras themselves and yeah, it's pretty clear
 just from looking at the live view feed that, you know, these cameras are working with some
 pretty serious hardware limitations.
 Like the image is kind of hazy and blown out and it does improve a little bit like after
 you take a picture.
 So if I pop it and it, you know, it's still kind of processing, but after it processes,
 you know, the sharpness and the exposure is improved a little bit, but it's still, you
 know, it's not the best selfie camera around.
 For some people who don't care too much about the quality of their selfies or their Zoom
 calls, maybe it is worth it.
 But if you do care about image quality with your selfies or if you want to take them in
 low light, you'll find that the technology really isn't ready yet, at least not for phones.
 Even experts like Stephen don't know if the trade off is worth it.
 Customers would look at that and see maybe like, you know, immediate benefit in that
 there's no notch.
 But front cameras are also doing many other things like biometric authentication and Windows
 Hello, and so you have to fit more things in there.
 And it's up in the air whether you can actually do biometrics behind a screen like that.
 And so, you know, are you really solving a problem?
 I'm not sure yet.
 So I think it's going to be challenging.
 I also think that sometimes people like to see where the camera is.
 And so, again, I'm not really sure whether it is.
 The benefit for the customers, obviously, you have no notch and you potentially have
 thin bezels at the top and the bottom.
 That might have some benefit from maybe an aesthetic point of view.
 But it's really hard to say.
 I would say in anything like this, there's basically pros and cons and you just have
 to think through it.
 And it depends on the product you're trying to build and experience you're trying to deliver.
 Stephen's team at Microsoft has focused their efforts with on the display cameras on larger
 video conferencing devices.
 They aren't set on solving the cosmetic issue of trying to eliminate bezels or notches,
 but are tackling a very real world problem, helping maintain eye contact over video calls.
 You know, I was really intent in trying to solve the problem for telepresence.
 And we've been working in this area for at least 15 years, where we wanted to help bring
 people together over video conferencing and make it feel like it's real.
 And one of the problems you want to solve there is to make the window basically like
 a real window, like I'm talking through you through an actual window rather than a computer
 screen, which is very two dimensional, doesn't take into account where you're looking, where
 your position is like in a real window does.
 And also wanted to do and solve for the cues that were really important in person to person
 communication like eye contact.
 We have a number of different research threads around trying to solve the problem, both optically
 and computationally.
 And of course, you know, one of the nice applications is okay, putting cameras underneath the display
 for the purposes of putting the camera where it needs to be to help with eye contact, right?
 Because if you have the camera where you're looking at it, you are making eye contact.
 And to also to hide the camera from from the bezel.
 Now it's important to note that Stephen mentions this tech is only made possible with plastic
 OLED screens, which explains why you're seeing it in phones first.
 Most work machines like laptops use LCDs.
 So it'll still be a minute before under display cameras start to appear in shipping devices.
 But Microsoft's efforts do show that there are uses for the idea beyond just shrinking
 phone bezels.
 Right now it's more of a neat curiosity than anything else.
 And I definitely don't think you should buy a phone based on this feature alone.
 These things tend to get better with time though.
 So who knows?
 Maybe cameras under the screen will soon be as common as fingerprint sensors.
 Okay, I have to speak from my personal point of view rather than like from like, you know,
 like Microsoft product making point of view.
 My personal point of view, I don't mind the bezels.
 I think that the bezel is a great place to put technology.
 And I don't want, you know, me personally, I would like the best front camera possible.