camera culture logo
Home   |   News   |   Join Us   |   People   |   Projects   |   Publications   |   Talks   |   Courses


HR3D: High-Rank 3D Display using Content Adaptive Parallax Barriers


Douglas Lanman Matthew Hirsch Yunhee Kim Ramesh Raskar
Camera Culture Group - MIT Media Lab

ACM SIGGRAPH Asia 2010. Transactions on Graphics 29(6)-163.
SIGGRAPH Asia 2010 Paper       Frequently Asked Questions       Press Package      

FAQ

Contents

  1. Q: Does the HR3D display require the viewer to wear any special equipment?
  2. Q: Is the HR3D display just another parallax barrier display?
  3. Q: How much brighter is the HR3D display?
  4. Q: Can't I just make the backlight brighter?
  5. Q: Why would anyone prefer this over a lenticular display?
  6. Q: What is the meaning of High Rank?
  7. Q: Is this similar to a hologram? (a.k.a. What's all this about Light Fields?)
  8. Q: What is the maximum frame rate of the prototype?
  9. Q: How is content generated for an HR3D display?
  10. Q: How can you show more images on a normal LCD screen? Is the content compressed?

Body

  1. Q: Does the HR3D display require the viewer to wear any special equipment?

    A: No, the HR3D display is an auto-multiscopic display. This means that without glasses, head tracking devices, or any special equipment worn by the viewer, it is possible to see a realistic 3D image will both horizontal and vertical parallax. Parallax means that the viewer can see around objects on the screen by moving his or her head. This is in contrast to stereoscopic imagery, which appears to distort as the viewer moves.

  2. Q: Is the HR3D display just another parallax barrier display?

    A: The HR3D display is a new type of barrier based display which we are calling a Content Adaptive Parallax Barrier. By adapting the barriers in our display to the content being shown, we can allow signficantly more light from the display to reach the viewer when showing imagery with full horizontal and vertical parallax. The adaptation can also be tuned to favor increased framerate, or brightness at the cost of image fidelity. This type of trade cannot be made with traditional parallax barriers.

  3. Q: How much brighter is the HR3D display?

    A: While the degree of brightening is a function of the angular and spatial resolution of the display, a comparison to traditional parallax barrier dispays will shed some light on the question. 3D displays that use 1D parallax barriers (horizontal parallax only) block less light than pinhole based displays (horizontal and vertical parallax). Our adaptation procedure is capable of creating a display with both horiztonal and vertical parallax that emits as much light as a screen using a standard 1D parallax barrier pattern. In practice, with our prototype, this results in an approximately 3× increase in brightness.

  4. Q: Can't I just make the backlight brither?

    A: In principle, yes. However, in practice environmental and economic considerations limit the power consumption of displays. Therefore, being more efficient with the use of emitted photons using technology like the HR3D display will improve display brightness in practice.

  5. Q: Why would anyone prefer this over a lenticular display?

    A: The primary disadvantage of a lenticular display is that once the lenses are attached to the screen, they cannot be removed. While 3D content is growing in popularity, much of the existing content available for viewing on displays is 2D. Using a barrier technology, such as HR3D which provides a switchable LCD front barrier, means that the display can easily switch between displaying a 3D image and a high-resolution 2D image. This is not possible when lenses are glued to the screen. Nintendo chose to use a barrier based technology in their latest 3DS gaming console for just this reason.

  6. Q: What is the meaning of High Rank?

    A: When we say rank here, we mean it in the linear algebra sense. In our technical paper we describe barrier based displays as rank-1. This means that if you try to represent a set of light rays using two attenuating layers, the resulting set of rays has very few degrees of freedom. The result is that you cannot accurately represent an arbitrary set of light rays with just two masks very well. We use this rank deficiency property to formulate an optimization that can solve for the best possible approximation to a given set of rays. The HR3D display creates a set of optimal low-rank approximations which are shown to the viewr very quickly (120Hz in our prototype). As the viewer's eye integrates each of these sub-frames together, a high-rank approximation to the desired set of light rays is constructed. So in a sense HR3D is in the eye of the beholder!

  7. Q: Is this similar to a hologram? (a.k.a. What's all this about Light Fields?)

    A: We use light fields tp analyze the HR3D display. Light fields assume that light travels along rays on a ballistic trajectory. This is a simplifying assumption that is valid so long as the light emitting and attenuating elements are large compared to the wavelength of light. Our HR3D screen works in this range. Holograms, on the other hand, work in a domain where the emitters and attenuators are on the same size scale as the wavelength of light. Typically people who create holograms use wave optics to analyze their creations. It has been shown by the Camera Culture group that augmented light fields can be used to analyze diffraction as well.

  8. Q: What is the maximum frame rate of the prototype?

    A: The prototype is built using two 120Hz Viewsonic LCD displays. At the lowest quality setting, using a single frame on each display to produce a desired light field, the prototype could run at the full 120Hz. This will result in very poor image quality. On the other hand, to accurately reproduce a the full-rank 3x3 light field, the display would only run at 120/9 Hz = 13Hz. This will usually fall below the flicker fusion threshold of the human eye. Therefore, we would typically choose to run the display at a rate somewhere between these two extremes. Interestingly, the rate that falls below the flicker fusion threshold for human vision will vary depending on lighting conditions. This means that the HR3D display can be run at lower rates/higher quality in low lighting conditions.

  9. Q: How is content generated for an HR3D display?

    A: In our technical paper we describe an optimization procedure used to generate frames for the HR3D prototype. This is a slow procedure, taking 8-20 minutes per frame depending on the resolution of the input light field and output imagery. Given what we now know about the structure of the generated masks (described in Figure 12 of our paper), we are confident that a much faster analytic solution will be found in the future.

  10. Q: How can you show more images on a normal LCD screen? Is the content compressed?

    A: Yes! Interestingly, this is an example of a compressive display. Imagery sent to an HR3D display is compressed, or "lossy". But it is compresseed in a way that allows the viewer's eye to decompress it. Any light field sent to an HR3D display is reduced down to two images — one for the front LCD and one for the rear LCD. It shouldn't be confusing now that the HR3D display is able to display more than two images on two LCD screens. Like other multiscopic 3D displays, the HR3D display trades spacial resolution for angular resolution.

Contact

Technical Details
Douglas Lanman, Postdoctoral Associate, MIT Media Lab
dlanman (at) media.mit.edu

Press
Alexandra Kahn, Senior Press Liaison, MIT Media Lab
akahn (at) media.mit.edu or 617/253.0365

Please visit the Camera Culture group page to see more projects.

Home   |   News   |   Join Us   |   People   |   Projects   |   Publications   |   Talks   |   Courses

MIT Media Lab - All rights reserved.