Adaptive leakage compensation using illuminant estimation for single sensor depth extraction

Abstract

In this paper, our goal is estimating depth information from a single camera system. From two off-centered apertures for visible and infrared (IR) spectra, we obtain two images which have a disparity in the RGB-IR color filter array. Since pixel spectral responses of RGB and IR are not ideally isolated, it generates leakage signals which are passed through the other aperture. Because the leakage signals degrade the depth accuracy and the image quality, we propose an adaptive leakage compensation method using an illuminant estimation algorithm. Using IR information, we determine the scene illuminant more correctly than the previous method with only RGB information. Experimental results show that the proposed method can accurately estimate the illuminant in normalized RGB-IR color space, and increase the depth accuracy and the image quality by canceling out leakage signal.