Research activities on holographic video in Japan
Yoshikawa, Hiroshi
Around 1990, researches on the electro-holography or the holographic video display had become very active in Japan. One of the reason might be that fine liquid crystal panels for television became commercially available. Another reason might be that the researchers were encouraged by the success of the holographic video display research at MIT. Recently, researches on holographic video display are getting very active again, though the goal is still challenging. This paper describes recent research activities on the holographic video system in Japan. It includes hologram calculations and acquisitions as well as displays.
 Here again, the title is it and I also provide URL and save your canals as my site. And first of all, this is the same slide as I showed in the last video. I think we have a second world in Japan about the research on the holograph video. Okay, so this is the percentage of the presentation at the 3D image components which include any kind of 3D magic. And this shows the percentage of the program it created presentation. So it was around 20% many years, the last two years, in 2000 I'm made and this year. So the percentage is suddenly up to 45%. And the recent research in Japan is the real-time holograph. Okay, so here shows the example. The holograph video created one, I think. And the real-time holograph from integral photogram in this and the real-time generation, this has real-time and lookup table for past calculation and viewing zone and measurement and full color and scanning display. So I will introduce these researches briefly. Since I want to introduce many researches, I just briefly give my information. And in the proceedings, I made a reference list so you can, if you are interested in, you can check. You can have a paper in the town. Okay, so past topic is the program for real-time object. So the research at NICD National Institute of Information and Communication Technology are working with NHK. NHK is a Japan Broadcasting Corporation. And what they did is the real-time holograph and combative IP is as integral photography. So you use a lens array to take a rubber wax image. Then they combative this IP image to program with hardware in real-time. This is how the integral photography works. So the... Okay, here shows the concept of the IP. So this is one-dimensional, but actually we have two-dimensional lens array. And each lens acts as a small camera. So this is something similar to the stereo ground. But the... so each parameter image has a different view of the object. Then, okay, usually this image is recorded on the film or captured by a device and used to reconstruct the image. But in this case, they capture the lens array and here is a high-election camera and object. So they make an integral photograph like image on the camera. So they capture the image to be seen and the captured image is sent to the hardware. So here shows the photograph of the hardware. It has a full DSP, institutional processing units. And in fact, as a FF team, first-person transform process, active algorithm. So each IP image is converted into something like a holographic stereo ground with full parallax. So, okay, this is the... a photograph of the IP camera. So here is... this is lens array and this is high-election camera. And here is the object. And this is reconstruction from the holograph generated in the airtime. And, okay, if you want this image is drawn because the focus is on this card. So this image is a focus. So next topic is engaging with the drone. Increase the horizontal viewing zone angle of the program by distribution, redistribution of spatial-like motor vehicle. This research is done by Professor Yasio Takagi, and he is a student at Tokyo University of Agriculture and Technology. I'm afraid my computer is crazy. Come on. Actually, the print's probably something complicated, but let me explain. Okay, here shows the so-called OF optics. So if you have an image, here is a clear frame and then image frame again. And they put the S-M here and also they put the four point sources. So four point sources is combative four, collimated beam, which has a different direction. So this lens has a Fourier transform of S-M here. So here we get four images of Fourier transform of S-M here, and the vertical position and the horizontal position is shifted. And in the S-M, they put a program pattern of four different programs. And so this program is the same, but the vertical position is shifted, and so they went straight. So this program 1, 2, 3, 4 is re-alleged as 4, 3, 2, 1. So it is equivalent. So increase horizontal pixel number, of course decreasing vertical pixel number. So we can increase horizontal building angle four times. Of course we reduce the vertical building angle one force. So this is the concept of the image, the photograph of the concept of the image of the display. So the display has a recovery, okay, so forth. Original pixel is 4K by 2K, but it's combative to 16,000 by 500. So building angle in horizontal is 15 degrees. It's enough for a bi-mocular observation. And we are also doing similar thing in different way. Our way is much more simple. What we do is we just want to reconfigure the pixel number like this. And what we do is we use mirror, center of mirror. So here is the hologram, and we illuminate light, and the light hits on the mirror, so vast mirror diverges the light. Then we have second mirror to align, so we are okay. So the virtual hologram is reshaped as a much more horizontal pixel and less vertical pixel. And this is our setup. We have two sets of mirror. This is the concept of the image, so we reconfigure 4K by 2K pixel to 8K by 1K. So of course, as I said, building zone is dark and original. Okay, next topic is color display. This is hard work. Usually, color display, people use the 3SLM and combine them into single optical axis. In the conventional project, they have optics which separate white light into RGB and also combine separated color to single beam. So we just use optics originally built in the project. So what we did is we just removed high pressure, high power lamp, and put white light LED. Okay, so the light is divided into green and also red-blue, and this prism act as a... This is very interesting. It acts as a polarizer and also the dichrome... I don't remember. It's separate color. So I calculate green, red, blue, 3CGH, then the light is instant and the reflected light is combined. So we can see the color image from here. So this is a projector, just commercially available projector, not a broken projector. We modified the projector so we can see the reconstructed image here. So this is a photograph of the reconstructed image. Okay, and this is original data, CG data, and it is reconstructed image, photograph of reconstructed image. And here I... hopefully, it's moving. Yeah, we are also working first calculation. So this is... of course, this is movie, but originally it's calculated on the personal computer in real time. So I want to move next topic. Next idea is color system. So the professor Sato at the University of Hyogo is working on the temporal multiplex color display. And also they also develop the color camera, color photographic camera. So here they use three RGB lasers and here is his object. And this is CCD camera with color filter. And this is display. So there is a single L-course with synchronized temporal multiplexing light. So it's time sequential RGB, RGB, and makes the color image. This is photograph of their hologram, also taken by their holographic camera. Okay, so this is... I think this is last topic. Anyway, this is new horizontal parallax only display. Horizontal parallax only display is... the MIT system is very famous as HPO system, but professor Takaki and his group proposed new HPO system. They are using high-speed SLM, which is DMD. And... okay, this is their system. They use very high-speed SLM. And only... it scans horizontal only. They enlarge in vertical. So this is just enlarged image of the SLM. And also they demagnify the SLM in horizontal and scan this elemental hologram only horizontally. So the scanning speed is very slow. And they... the DMD frame rate is 13.3 kiloframes per second. So they can put 220 elemental holograms at the rate of the 60 frames, 60 holographic frames per second. This is the photograph of reconstructed image from their system. Okay, in conclusion, for practical holographic video display, I think now the cost does matter. So we can technically make it, but the cost is a problem. And I believe horizontal parallax only is more practical. And the measure breakthrough on SLM is required, particularly for the full parallax holographic television. And the... today I only introduced display, but holographic data transmission storage and the computations are also important. Okay, that's it. Thank you for your attention. Thank you.
 Here again, the title is it and I also provide URL and save your canals as my site.  And first of all, this is the same slide as I showed in the last video.  I think we have a second world in Japan about the research on the holograph video.  Okay, so this is the percentage of the presentation at the 3D image components which include any kind of 3D magic.  And this shows the percentage of the program it created presentation.  So it was around 20% many years, the last two years, in 2000 I'm made and this year.  So the percentage is suddenly up to 45%.  And the recent research in Japan is the real-time holograph.  Okay, so here shows the example.  The holograph video created one, I think. And the real-time holograph from integral photogram in this and the real-time generation,  this has real-time and lookup table for past calculation and viewing zone and measurement and full color and scanning display.  So I will introduce these researches briefly. Since I want to introduce many researches, I just briefly give my information.  And in the proceedings, I made a reference list so you can, if you are interested in, you can check.  You can have a paper in the town. Okay, so past topic is the program for real-time object.  So the research at NICD National Institute of Information and Communication Technology are working with NHK.  NHK is a Japan Broadcasting Corporation.  And what they did is the real-time holograph and combative IP is as integral photography.  So you use a lens array to take a rubber wax image.  Then they combative this IP image to program with hardware in real-time.  This is how the integral photography works.  So the...  Okay, here shows the concept of the IP.  So this is one-dimensional, but actually we have two-dimensional lens array.  And each lens acts as a small camera. So this is something similar to the stereo ground.  But the... so each parameter image has a different view of the object.  Then, okay, usually this image is recorded on the film or captured by a device and used to reconstruct the image.  But in this case, they capture the lens array and here is a high-election camera and object.  So they make an integral photograph like image on the camera.  So they capture the image to be seen and the captured image is sent to the hardware.  So here shows the photograph of the hardware.  It has a full DSP, institutional processing units.  And in fact, as a FF team, first-person transform process, active algorithm.  So each IP image is converted into something like a holographic stereo ground with full parallax.  So, okay, this is the... a photograph of the IP camera.  So here is... this is lens array and this is high-election camera.  And here is the object.  And this is reconstruction from the holograph generated in the airtime.  And, okay, if you want this image is drawn because the focus is on this card.  So this image is a focus.  So next topic is engaging with the drone.  Increase the horizontal viewing zone angle of the program by distribution,  redistribution of spatial-like motor vehicle.  This research is done by Professor Yasio Takagi,  and he is a student at Tokyo University of Agriculture and Technology.  I'm afraid my computer is crazy.  Come on.  Actually, the print's probably something complicated, but let me explain.  Okay, here shows the so-called OF optics.  So if you have an image, here is a clear frame and then image frame again.  And they put the S-M here and also they put the four point sources.  So four point sources is combative four,  collimated beam, which has a different direction.  So this lens has a Fourier transform of S-M here.  So here we get four images of Fourier transform of S-M here,  and the vertical position and the horizontal position is shifted.  And in the S-M, they put a program pattern of four different programs.  And so this program is the same, but the vertical position is shifted,  and so they went straight.  So this program 1, 2, 3, 4 is re-alleged as 4, 3, 2, 1.  So it is equivalent.  So increase horizontal pixel number, of course decreasing vertical pixel number.  So we can increase horizontal building angle four times.  Of course we reduce the vertical building angle one force.  So this is the concept of the image,  the photograph of the concept of the image of the display.  So the display has a recovery, okay, so forth.  Original pixel is 4K by 2K, but it's combative to 16,000 by 500.  So building angle in horizontal is 15 degrees.  It's enough for a bi-mocular observation.  And we are also doing similar thing in different way.  Our way is much more simple.  What we do is we just want to reconfigure the pixel number like this.  And what we do is we use mirror, center of mirror.  So here is the hologram, and we illuminate light,  and the light hits on the mirror, so vast mirror diverges the light.  Then we have second mirror to align, so we are okay.  So the virtual hologram is reshaped as a much more horizontal pixel and less vertical pixel.  And this is our setup.  We have two sets of mirror.  This is the concept of the image, so we reconfigure 4K by 2K pixel to 8K by 1K.  So of course, as I said, building zone is dark and original.  Okay, next topic is color display.  This is hard work.  Usually, color display, people use the 3SLM and combine them into single optical axis.  In the conventional project, they have optics which separate white light into RGB and also combine separated color to single beam.  So we just use optics originally built in the project.  So what we did is we just removed high pressure, high power lamp, and put white light LED.  Okay, so the light is divided into green and also red-blue, and this prism act as a...  This is very interesting.  It acts as a polarizer and also the dichrome...  I don't remember. It's separate color.  So I calculate green, red, blue, 3CGH, then the light is instant and the reflected light is combined.  So we can see the color image from here.  So this is a projector, just commercially available projector, not a broken projector.  We modified the projector so we can see the reconstructed image here.  So this is a photograph of the reconstructed image.  Okay, and this is original data, CG data, and it is reconstructed image, photograph of reconstructed image.  And here I... hopefully, it's moving.  Yeah, we are also working first calculation.  So this is... of course, this is movie, but originally it's calculated on the personal computer in real time.  So I want to move next topic.  Next idea is color system.  So the professor Sato at the University of Hyogo is working on the temporal multiplex color display.  And also they also develop the color camera, color photographic camera.  So here they use three RGB lasers and here is his object.  And this is CCD camera with color filter.  And this is display. So there is a single L-course with synchronized temporal multiplexing light.  So it's time sequential RGB, RGB, and makes the color image.  This is photograph of their hologram, also taken by their holographic camera.  Okay, so this is... I think this is last topic. Anyway, this is new horizontal parallax only display.  Horizontal parallax only display is... the MIT system is very famous as HPO system,  but professor Takaki and his group proposed new HPO system.  They are using high-speed SLM, which is DMD.  And... okay, this is their system. They use very high-speed SLM.  And only... it scans horizontal only. They enlarge in vertical.  So this is just enlarged image of the SLM.  And also they demagnify the SLM in horizontal and scan this elemental hologram only horizontally.  So the scanning speed is very slow.  And they... the DMD frame rate is 13.3 kiloframes per second.  So they can put 220 elemental holograms at the rate of the 60 frames, 60 holographic frames per second.  This is the photograph of reconstructed image from their system.  Okay, in conclusion, for practical holographic video display,  I think now the cost does matter. So we can technically make it, but the cost is a problem.  And I believe horizontal parallax only is more practical.  And the measure breakthrough on SLM is required, particularly for the full parallax holographic television.  And the... today I only introduced display, but holographic data transmission storage and the computations are also important.  Okay, that's it. Thank you for your attention.  Thank you.
Research_activities_on_holographic_video_in_Japan_0_59.png Research_activities_on_holographic_video_in_Japan_60_491.png Research_activities_on_holographic_video_in_Japan_492_1403.png Research_activities_on_holographic_video_in_Japan_1404_2219.png Research_activities_on_holographic_video_in_Japan_2220_3827.png Research_activities_on_holographic_video_in_Japan_3828_5171.png Research_activities_on_holographic_video_in_Japan_5172_5255.png Research_activities_on_holographic_video_in_Japan_5256_6599.png Research_activities_on_holographic_video_in_Japan_6600_7583.png Research_activities_on_holographic_video_in_Japan_7584_8615.png Research_activities_on_holographic_video_in_Japan_8616_10127.png Research_activities_on_holographic_video_in_Japan_10128_11159.png Research_activities_on_holographic_video_in_Japan_11160_12227.png Research_activities_on_holographic_video_in_Japan_12228_13415.png Research_activities_on_holographic_video_in_Japan_13416_13583.png Research_activities_on_holographic_video_in_Japan_13584_14027.png Research_activities_on_holographic_video_in_Japan_14028_14207.png Research_activities_on_holographic_video_in_Japan_14208_16355.png Research_activities_on_holographic_video_in_Japan_16356_16835.png Research_activities_on_holographic_video_in_Japan_16836_17039.png Research_activities_on_holographic_video_in_Japan_17040_17603.png Research_activities_on_holographic_video_in_Japan_17604_17759.png Research_activities_on_holographic_video_in_Japan_17760_17903.png Research_activities_on_holographic_video_in_Japan_17904_18479.png Research_activities_on_holographic_video_in_Japan_18480_19139.png Research_activities_on_holographic_video_in_Japan_19140_19991.png Research_activities_on_holographic_video_in_Japan_19992_21443.png Research_activities_on_holographic_video_in_Japan_21444_21647.png Research_activities_on_holographic_video_in_Japan_21648_22811.png Research_activities_on_holographic_video_in_Japan_22812_22855.png
Here again, the title is it and I also provide URL and save your canals as my site. And first of all, this is the same slide as I showed in the last video. I think we have a second world in Japan about the research on the holograph video. Okay, so this is the percentage of the presentation at the 3D image components which include any kind of 3D magic. And this shows the percentage of the program it created presentation. So it was around 20% many years, the last two years, in 2000 I'm made and this year. So the percentage is suddenly up to 45%. And the recent research in Japan is the real-time holograph. Okay, so here shows the example. The holograph video created one, I think. And the real-time holograph from integral photogram in this and the real-time generation, this has real-time and lookup table for past calculation and viewing zone and measurement and full color and scanning display. So I will introduce these researches briefly. Since I want to introduce many researches, I just briefly give my information. And in the proceedings, I made a reference list so you can, if you are interested in, you can check. You can have a paper in the town. Okay, so past topic is the program for real-time object. So the research at NICD National Institute of Information and Communication Technology are working with NHK. NHK is a Japan Broadcasting Corporation. And what they did is the real-time holograph and combative IP is as integral photography. So you use a lens array to take a rubber wax image. Then they combative this IP image to program with hardware in real-time. This is how the integral photography works. So the... Okay, here shows the concept of the IP. So this is one-dimensional, but actually we have two-dimensional lens array. And each lens acts as a small camera. So this is something similar to the stereo ground. But the... so each parameter image has a different view of the object. Then, okay, usually this image is recorded on the film or captured by a device and used to reconstruct the image. But in this case, they capture the lens array and here is a high-election camera and object. So they make an integral photograph like image on the camera. So they capture the image to be seen and the captured image is sent to the hardware. So here shows the photograph of the hardware. It has a full DSP, institutional processing units. And in fact, as a FF team, first-person transform process, active algorithm. So each IP image is converted into something like a holographic stereo ground with full parallax. So, okay, this is the... a photograph of the IP camera. So here is... this is lens array and this is high-election camera. And here is the object. And this is reconstruction from the holograph generated in the airtime. And, okay, if you want this image is drawn because the focus is on this card. So this image is a focus. So next topic is engaging with the drone. Increase the horizontal viewing zone angle of the program by distribution, redistribution of spatial-like motor vehicle. This research is done by Professor Yasio Takagi, and he is a student at Tokyo University of Agriculture and Technology. I'm afraid my computer is crazy. Come on. Actually, the print's probably something complicated, but let me explain. Okay, here shows the so-called OF optics. So if you have an image, here is a clear frame and then image frame again. And they put the S-M here and also they put the four point sources. So four point sources is combative four, collimated beam, which has a different direction. So this lens has a Fourier transform of S-M here. So here we get four images of Fourier transform of S-M here, and the vertical position and the horizontal position is shifted. And in the S-M, they put a program pattern of four different programs. And so this program is the same, but the vertical position is shifted, and so they went straight. So this program 1, 2, 3, 4 is re-alleged as 4, 3, 2, 1. So it is equivalent. So increase horizontal pixel number, of course decreasing vertical pixel number. So we can increase horizontal building angle four times. Of course we reduce the vertical building angle one force. So this is the concept of the image, the photograph of the concept of the image of the display. So the display has a recovery, okay, so forth. Original pixel is 4K by 2K, but it's combative to 16,000 by 500. So building angle in horizontal is 15 degrees. It's enough for a bi-mocular observation. And we are also doing similar thing in different way. Our way is much more simple. What we do is we just want to reconfigure the pixel number like this. And what we do is we use mirror, center of mirror. So here is the hologram, and we illuminate light, and the light hits on the mirror, so vast mirror diverges the light. Then we have second mirror to align, so we are okay. So the virtual hologram is reshaped as a much more horizontal pixel and less vertical pixel. And this is our setup. We have two sets of mirror. This is the concept of the image, so we reconfigure 4K by 2K pixel to 8K by 1K. So of course, as I said, building zone is dark and original. Okay, next topic is color display. This is hard work. Usually, color display, people use the 3SLM and combine them into single optical axis. In the conventional project, they have optics which separate white light into RGB and also combine separated color to single beam. So we just use optics originally built in the project. So what we did is we just removed high pressure, high power lamp, and put white light LED. Okay, so the light is divided into green and also red-blue, and this prism act as a... This is very interesting. It acts as a polarizer and also the dichrome... I don't remember. It's separate color. So I calculate green, red, blue, 3CGH, then the light is instant and the reflected light is combined. So we can see the color image from here. So this is a projector, just commercially available projector, not a broken projector. We modified the projector so we can see the reconstructed image here. So this is a photograph of the reconstructed image. Okay, and this is original data, CG data, and it is reconstructed image, photograph of reconstructed image. And here I... hopefully, it's moving. Yeah, we are also working first calculation. So this is... of course, this is movie, but originally it's calculated on the personal computer in real time. So I want to move next topic. Next idea is color system. So the professor Sato at the University of Hyogo is working on the temporal multiplex color display. And also they also develop the color camera, color photographic camera. So here they use three RGB lasers and here is his object. And this is CCD camera with color filter. And this is display. So there is a single L-course with synchronized temporal multiplexing light. So it's time sequential RGB, RGB, and makes the color image. This is photograph of their hologram, also taken by their holographic camera. Okay, so this is... I think this is last topic. Anyway, this is new horizontal parallax only display. Horizontal parallax only display is... the MIT system is very famous as HPO system, but professor Takaki and his group proposed new HPO system. They are using high-speed SLM, which is DMD. And... okay, this is their system. They use very high-speed SLM. And only... it scans horizontal only. They enlarge in vertical. So this is just enlarged image of the SLM. And also they demagnify the SLM in horizontal and scan this elemental hologram only horizontally. So the scanning speed is very slow. And they... the DMD frame rate is 13.3 kiloframes per second. So they can put 220 elemental holograms at the rate of the 60 frames, 60 holographic frames per second. This is the photograph of reconstructed image from their system. Okay, in conclusion, for practical holographic video display, I think now the cost does matter. So we can technically make it, but the cost is a problem. And I believe horizontal parallax only is more practical. And the measure breakthrough on SLM is required, particularly for the full parallax holographic television. And the... today I only introduced display, but holographic data transmission storage and the computations are also important. Okay, that's it. Thank you for your attention. Thank you.
And the recent research in Japan is the real-time real-time and lookup table for past calculation real-time object. So the research at NICD image is recorded on the film or captured by a photograph of the concept of the image of the so we are okay. So the virtual hologram is as a... This is very interesting. It acts as a projector, just commercially available projector, parallax only display is... the MIT system is holographic video display, I think now the cost the full parallax holographic television. And