Todor Georgiev
Principal Scientist, Adobe
todor at tgeorgiev dot net
Latest paper: Sensor MTF, Interferometric Measurements
Todor Georgiev on ResearchGate Introduction to Light Field Capture and Plenoptic Camera .
This website covers active research in the area of Light Fields until 2014
ICIP 2014 paper: The Radon Image as Plenoptic Function
ECCV 2014 course: Theory and Methods of Lightfield Photography , Sept 7, 2014.
My Seagull
Gallery and Data -- not only seagulls...
Full sensor resolution
Superresolution -- see ICCP presentation on superresolution: Plenoptic Sampling and Rendering, April 2012.
My Publications on Lightfields
-
Lytro Keynote presentation at Electronic Imaging, Feb 05 2013.
- Yu, Z., Yu, J., Lumsdaine, A., Georgiev, T., An Analysis of Color Demosaicing in Plenoptic Cameras, CVPR, June 2012.
- Georgiev, T., Lumsdaine, A., The Multi-Focus Plenoptic Camera, SPIE Electronic Imaging, Jan 2012. Presentation slides
- Lumsdaine, A., Georgiev, T., Chunev, G., Spatial Analysis of Discrete Plenoptic Sampling, SPIE Electronic Imaging, Jan 2012. Sampling of phase space with the Lippmann sensor:
- Lumsdaine, A., Chunev, G., Georgiev, T., Plenoptic Rendering with Interactive Performance Using GPUs, SPIE Electronic Imaging, Jan 2012.
- Georgiev, T., Lumsdaine, A., Goma, S., Plenoptic Principal Planes, Imaging Systems and Applications (IS), OSA Topical Meeting, July 2011. Presentation slides. We demonstrate optical equivalence between the plenoptic camera and the camera array.
- Georgiev, T., Chunev, G., Lumsdaine, A., Superresolution with the Focused Plenoptic Camera, SPIE Electronic Imaging, Jan 2011. Notice the chain in the right image:
- Chunev, G., Lumsdaine, A., Georgiev, T., Plenoptic Rendering with Interactive Performance Using GPUs, SPIE Electronic Imaging, Jan 2011.
- Georgiev, T., Lumsdaine, A., Chunev, G., Using Focused Plenoptic Cameras for Rich Image Capture, IEEE Computer Graphics and Applications, Jan 2011. Includes a new section on polarization.
Lumsdaine, A., Chunev, G., Georgiev, T., Computational Photography: Real Time Plenoptic Rendering, NVIDIA GPU Technology Conference, Sep 2010. Demo and Comments, ppt
Georgiev, T., Lumsdaine, A., Reducing Plenoptic Camera Artifacts, Computer Graphics Forum, June 2010.
Paper and lightfield data available upon request: todor at tgeorgiev dot net
Georgiev, T., Lumsdaine, A., Focused Plenoptic Camera and Rendering, Journal of Electronic Imaging, Volume 19, Issue 2, 2010. Describes interactive GPU algorithms for image rendering from Plenoptic 2.0 camera. PDF Georgiev, T., Lumsdaine, A., Rich Image Capture with Plenoptic Cameras, ICCP, March 2010. This work compares two methods of rich image capture at high resolution possible only with the focused plenoptic camera. Part of Lightfield HDR Project
- Georgiev, T., New Results on the Plenoptic 2.0 Camera, Asilomar Conference on Signals, Systems, and Computers, November 2009.
- Georgiev, T., Lumsdaine, A., Goma, S., High Dynamic Range Image Capture with Plenoptic 2.0 Camera, Signal Recovery and Synthesis (SRS), Fall OSA Optics & Photonics Congress, 2009. We demonstrate HDR imaging with Plenoptic 2.0 camera.
Georgiev, T., Lumsdaine, A., Resolution in Plenoptic Cameras, COSI, October 2009. We demonstrate mathematically why the resolution of the Plenoptic 2.0 camera is higher than the resolution of the Plenoptic camera.
Georgiev, T., Lumsdaine, A., Superesolution with Plenoptic 2.0 Cameras, SRS, October 2009. Data
Compare traditional rendering (left) with Plenoptic 2.0 rendering (middle) with Superresolution (right):
Georgiev, T., Lumsdaine, A., Superresolution with Plenoptic Camera 2.0 , Adobe Tech Report, April 2009. We show geometrically that the array of microimages in a Plenoptic 2.0 camera can be used for superresolution. We derive the conditions that make this possible. We also prove lightfield superresolution experimentally.
Lumsdaine, A., Georgiev, T., The Focused Plenoptic Camera, ICCP, April 2009. Uncompressed version of the paper with high resolution images. Detailed analysis of the Plenoptic 2.0 Camera. Radiance / lightfield data directly from our camera (Galilean telescopic array), and refocusing. Two movies created from our Keplerian camera data: refocusing, and changing the viewpoint.
Georgiev, T., Lumsdaine, A., Depth of Field in Plenoptic Cameras, Eurographics 2009. As can be seen from this comparison image, "plenoptic depth of field" is very different from depth of field in a conventional camera. We derive some simple but unusual formulas. Feel free to use this radiance / lightfield data, directly from our camera (Keplerian telescopic array).
That's how Lytro works: Keplerian and Galilean at the same time
Georgiev, T., Intwala, C., Babacan, S., Lumsdaine, A., Unified Frequency Domain Analysis of Lightfield Cameras, ECCV 2008. Lightfield data and Videos.
Story, D., Whitmire, E., Georgiev, T., The Future of Photography (in Japanese), Optics / Electronics, Oct 2008. The Future of Photography (English draft).
Intwala, C., Georgiev, T., "Removing Artifacts Due to Frequency-Domain Processing of Lightfields", Eurographics, April 2008.
Lumsdaine, A., Georgiev, T., Full Resolution Lightfield Rendering, Adobe Tech Report, January 2008. We show that 500 times increase in the resolution of the plenoptic camera is possible! Originally submitted to SIGGRAPH 2008.
Related CVPR presentation on Plenoptic Camera 2.0 (Focused Plenoptic Camera). Diagram of the camera.
Data: Lightfields freely available for experimentation: A crop (72 MB) and full data (1.5 GB). This may be the largest lightfield ever captured with a single camera.
Demos: Comparison with Lightfield Rendering (Plenoptic vs. Plenoptic 2.0 rendering). A video shows incredible detail!
Changing viewpoint with Plenoptic 2.0 camera data. UTube video
Adobe presentation on The History of Lightfield Ideas
Adobe Tech Report, April 2007 Lightfield Capture by Frequency Multiplexing. Careful theoretical derivation of what MERL authors call "Dappled Photography" and "Heterodyning". Proving that frequency multiplexing works for both mask-based and microlens-based cameras. This is a new result. It shows that the approach is truly universal: It's not a special "heterodyning" type of camera, but a "heterodyning" method of processing the data, applicable to any camera! Also, proposing a new "mosquito net" camera. And much more (wave artifact removal, F/number analysis). Examples.
Georgiev, T., Zheng, C., Nayar, S., Curless, B., Salesin, D., Intwala, C., Spatio-angular Resolution Trade-offs in Integral Photography, EGSR 2006. My presentation slides and Videos. Brian's presentation slides.
Georgiev, T., Light Field Camera Demo, ECCV 2006.
Georgiev, T., Intwala, C.,Tech Report on Integral View Photography Adobe, February 2006.
Georgiev, T., “Compound Eye Camera”, Tech Report, October 2004.
Georgiev, T., Nikolov, P., “ Light Field Geometry”, Theoretical paper with Petko, April 2004
-
Georgiev, T., “Relighting, Retinex Theory and Perceived Gradients.” Mirage 2005, INRIA, Ricquencourt, France, March 2005.
Georgiev, T., “Image Reconstruction Invariant to Relighting”, EUROGRAPHICS 2005.
Georgiev, T., Presentation at Computational Photography 2005
Georgiev, T., “Covariant Derivatives and Vision”, ECCV 2006. Presentation slides with MP3 sound file. Also, here is a related paper on Bilateral filter
.
Silicon Valley SIGGRAPH presentation: The Camera of the Future
Keynote with Jensen and Salesin. NVIDIA GPU Technology Conference, Sep 2010.
Full Radiance / Lightfield data
CVPR 2010 Demo: Real Time Lightfield Rendering Using GPUs. Demonstrating interactive high resolution refocusable stereo 3D with NVIDIA glasses. The latest development on Adelson's Single Lens Stereo with Plenoptic Camera. Plenoptic data available upon request: todor at tgeorgiev dot net
Keynote at WSCG 2010
Light Field HDR project High resolution capture of HDR, Multispectral color, Polarization and other plenoptic function modalities with Plenoptic 2.0 Camera.
Historical Light Field
The very first light fields were captured by Lippmann, 1908. It took over 100 years to bring Integral Photography to market (see article in Scientific American 1911). Integral/Plenoptic/Lightfield cameras you can actually buy today: Lytro and Raytrix
Lippmann (1908): Epreuves Reversibles. Translation: Reversible Prints. Thanks to Fredo Durand, Shmuel Peleg, Nicolas Merlet and Sylvain Paris.
Sokolov (1911): Autostereoscopy and Integral Photography by Professor Lippmann's Method. Thanks to Ekaterina Avramova and Daniel Reetz.
Courses
SPIE Electronic Imaging 2014 course: Theory and Methods of Lightfield Photography (SC980), Feb 02 2014.
Eurographics 2010 Theory and Methods of Lightfield Photography
SPIE Electronic Imaging 2010 Course: Theory and Methods of Lightfield Photography
SIGGRAPH Asia 2009 Course: Theory and Methods of Lightfield Photography
The Single Most Important Image Ever Taken by Humanity
Judging Books by Their Covers
Martin Eden
