Contact us at:+90 (216) 681 5141
 
Hybrid-Sensor High-Resolution Light Field Imaging

Abstract:

Light field imaging is an emerging research field due to the new capabilities it brings, including post-capture refocusing, aperture control, and 3D modeling. Single-shot single sensor light field cameras try to balance the fundamental trade-off between spatial and angular resolution. The spatial resolution achieved with such cameras is typically far from being satisfactory, limiting the extensive adoption of light field cameras. In this paper, we present a hybrid-sensor light field camera that uses minimal optical components, a regular sensor and a micro-lens array based light field sensor to produce high-spatial resolution light field. The use of a single lens and matching image planes prevent complexities, such as occlusions, that multi lens systems suffer from. In our experiments, we demonstrate that the proposed hybrid-sensor camera leads to improved depth estimation in addition to increase in spatial resolution.

Publication(s):

"Hybrid-sensor high-resolution light field imaging,"
M Umair Mukati and Bahadir K Gunturk,
Proceedings of 25th IEEE Signal Processing and Communication Application Conference (SIU), 2017 ,
[PDF]

Funding:

TUBITAK grant 1003

Images:

Proposed optical design.

Top view of the hardware setup based on the optical design.

Illustration of the proposed light field resolution enhancement algorithm.
Spatial resolution enhancement of light field. (a) Low-resolution bilinearly interpolated light field captured by the light field sensor; (b) Spatially enhanced light field as a result of the proposed algorithm.
Spatial resolution comparison between original and spatially enhanced light fields for digital refocusing. Using the shift-and-sum technique, light fields are focused at three different depths for both low-resolution and high-resolution light fields.
Improvement in epipolar plane image (EPI) due to spatial resolution enhancement. (a) Low-resolution light field sub-aperture image; (b) High-resolution light field sub-aperture image; (c) EPI for the low-resolution light field; (d) EPI for the high-resolution light field.
Disparity map comparison. Left: Disparity map for the original light field. Right: Disparity map for the spatially enhanced light field.