Lightfield HDR: HDR Capture with Plenoptic 2.0 Camera

Signal Recovery and Synthesis (SRS)

Fall OSA Optics & Photonics Congress, 2009

Todor Georgiev, Andrew Lumsdaine and Sergio Goma

Plenoptic HDR has been an active project in Adobe since 2008. The idea is that since different microlenses in the Plenoptic 2.0 camera capture multiple pictures at the same time, the camera can be used with modified microlens apertures for HDR and other extended imaging.

The great value of this approach comes from the fact that Plenoptic 2.0 resolution is much higher than what's possible with traditional lightfield rendering (Plenoptic 1.0). Our camera is capable of reaching almost full sensor resolution! We have potentially very sparse sampling of the plenoptic function, impossible with traditional lightfield camera. The question is, how useful are those extended capabilities for real world photography?

The idea to use Lightfield architecture for captuding HDR, multi-spectral color and polarization has been independently proposed by Horstmeyer and his colleagues. We learned about their approach at ICCP 2009. The difference is that their approach is based on Plenoptic 1.0, while ours is based on Plenoptic 2.0 camera.

Our first step has been to demonstrate that our high resolution method works, and to see how much is possible with it. Below are some early results that are very exciting:

My working table. Animation created from a single snapshot capturing two different exposures:


Presentation Slides

Our microlenses with interleaved chromium apertures were made by Leister Axetris back in December 2008. In the picture below I tried to capture the amazing quality of their work: