Open Access Open Access  Restricted Access Subscription or Fee Access

Color Reproduction from Noisy CFA Data of Single Sensor Digital Cameras

Dr. K. Ashok Babu, G. Kesavan Pillai, Nalla Nandakishore

Abstract


Single sensor digital color still/video cameras capture images using a color filter array (CFA) and require color interpolation (demosaicking) to reconstruct full color images. The color reproduction has to combat sensor noises which are channel dependent. If untreated in demosaicking, sensor noises can cause color artifacts that are hard to remove later by a separate Denoising process, because the demosaicking process complicates the noise characteristics by blending noises of different color channels. This paper presents a joint demosaicking-denoising approach to overcome this difficulty. The color image is restored from noisy mosaic data in two steps. First, the difference signals of color channels are estimated by linear minimum mean square-error estimation. This process exploits both spectral and spatial correlations to simultaneously suppress sensor noise and interpolation error. With the estimated difference signals, the full resolution green channel is recovered. The second step involves in a wavelet-based Denoising process to remove the CFA channel-dependent noises from the reconstructed green channel. The red and blue channels are subsequently recovered. Simulated and real CFA mosaic data are used to evaluate the performance of the proposed joint demosaicking-denoising scheme and compare it with many recently developed sophisticated demosaicking and denoising schemes.

Keywords


Bayer pattern, color demosaicking, color filter array (CFA), denoising, wavelet.

Full Text:

PDF

References


B. E. Bayer, “Color imaging array,” U.S. patent 3 971 065, 1975.

P. Longère, X. Zhang, P. B. Delahunt, and D. H. Brainard, “Perceptual assessment of demosaicing algorithm performance,” Proc. IEEE, vol. 90, no. 1, pp. 123–132, Jan. 2002.

D. R. Cok, “Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal,” U.S. Patent 4 642 678, 1987.

J. E. Adams, “Intersections between color plane interpolation and other image processing functions in electronic photography,” Proc. SPIE, vol. 2416, pp. 144–151, 1995.

J. E. Adams and J. F. Hamilton Jr, “Adaptive color plane interpolation in single color electronic camera,” U.S. Patent 5.506 619, 1996.

J. E. Adams, “Design of practical color filter array interpolation algorithms for digital cameras,” Proc. SPIE, vol. 3028, pp. 117–125, 1997.

E. Chang, S. Cheung, and D. Y. Pan, “Color filter array recovery using a threshold-based variable number of gradients,” Proc. SPIE, vol. 3650, pp. 36–43, 1999.

R. Kimmel, “Demosaicing: Image reconstruction from CCD Samples,” IEEE Trans. Image Process., vol. 8, no. 9, pp. 1221–1228, Sep. 1999.

B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, “Color plane interpolation using alternating projections,” IEEE Trans. Image Process.,vol. 11, no. 9, pp. 997–1013, Sep. 2002.

B. K. Gunturk, J. Glotzbach, Y. Altunbasak, R. W. Schafer, and R. M. Mersereau, “Demosaicking: Color filter array interpolation in singlechip digital cameras,” IEEE Signal Process. Mag., vol. 22, no. 1, pp. 44–54, Jan. 2005.

L. Zhang and X. Wu, “Color demosaicking via directional linear minimum mean square-error estimation,” IEEE Trans. Image Process., vol. 14, no. 12, pp. 2167–2178, Dec. 2005.

K. Hirakawa and T. W. Parks, “Adaptive homogeneity-directed demosaicing algorithm,” IEEE Trans. Image Process., vol. 14, no. 3, pp.360–369, Mar. 2005.

R. Kakarala and Z. Baharav, “Adaptive demosaicing with the principal vectormethod,” IEEE Trans. Consum. Electron., vol. 48, no. 11, pp. 932–937, Nov. 2002.

W. Lu and Y. Tan, “Color filter array demosaicking: New method and performance measures,” IEEE Trans. Image Process., vol. 12, no. 10, pp. 1194–1210, Oct. 2003.

S. C. Pei and I. K. Tam, “Effective color interpolation in CCD color filter arrays using signal correlation,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 6, pp. 503–513, Jun. 2003.

R. Lukac, B. Smolka, K. Martin, K. N. Plataniotis, and A. N. Venetsanopoulos, “Vector filtering for color imaging,” IEEE Signal Process. Mag., vol. 22, no. 1, pp. 74–86, Jan. 2005.

R. Lukac and K. N. Plataniotis, “Color filter arrays: Design and performance analysis,” IEEE Trans. Consum. Electron., vol. 51, no. 4, pp. 1260–1267, Nov. 2005.

R. Lukac and K. N. Plataniotis, “Data-adaptive filters for demosaicking: A framework,” IEEE Trans. Consum. Electron., vol. 51, no.2, pp. 560–570, May 2005.

R. Lukac, K. Martin, and K. N. Plataniotis, “Demosaicked image postprocessing using local color ratios,” IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 914–920, Jun. 2004.

X. Li, “Demosaicing by successive approximation,” IEEE Trans. Image Process., vol. 14, no. 3, pp. 370–379, Mar. 2005.

D. Alleysson, S. Susstrunk, and J. Herault, “Linear demosaicing inspired by the human visual system,” IEEE Trans. Image Process., vol. 14, no. 4, pp. 439–449, Apr. 2005.

S. Farsiu, M. Elad, and P. Milanfar, “Multiframe demosaicing and super-resolution of color images,” IEEE Trans. Image Process., vol. 15, no. 1, pp. 141–159, Jan. 2006.

D. D. Muresan and T. W. Parks, “Demosaicing using optimal recovery,” IEEE Trans. Image Process., vol. 14, no. 2, pp. 267–278, Feb. 2005.

B. Tao, I. Tastl, T. Cooper,M. Blasgen, and E. Edwards, “Demosaicing using human visual properties and wavelet interpolation filtering,” in Proc. IS&T/SID 7th Color Imaging Conf.: Color Science, Systems, Applications, Scottsdale, AZ, Nov. 1999, vol. 7, pp. 252–256.

Daubechies, “Orthonormal bases of compactly supported wavelets,” Comm. Pure Appl. Math., vol. 41, pp. 909–996, 1988.

Cohen, I. Daubechies, and J. C. Feauveau, “Biorthogonal bases of compactly supported wavelets,” Commun. Pure Appl. Math., vol. 45, pp. 485–560, 1992.

D. L. Donoho and I. M. Johnstone, “Ideal spatial adaptation viawavelet shrinkage,” Biometrika, vol. 81, pp. 425–455, 1994.

R. R. Coifman and D. L. Donoho, “Translation-invariant de-noising,” in Wavelet and Statistics, A. Antoniadis and G. Oppenheim, Eds., 1st ed. Berlin, Germany: Springer, 1995.

S. G. Chang, B. Yu, and M. Vetterli, “Spatially adaptive wavelet thresholding with context modeling for image denoising,” IEEE Trans. Image Process., vol. 9, no. 9, pp. 1522–1531, Sep. 2000.

Q. Pan, L. Zhang, G. Dai, and H. Zhang, “Two denoising methods by wavelet transform,” IEEE Trans. Signal Process., vol. 47, no. 12, pp. 3401–3406, Dec. 1999.

L. Zhang, P. Bao, and X. Wu, “Multiscle LMMSE-based image denoising with optimal wavelet selection,” IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 4, pp. 469–481, Apr. 2005.

M. K. Mihçak, I. Kozintsev, K. Ramchandran, and P. Moulin, “Lowcomplexity image denoising based on statistical modeling of wavelet coefficients,” IEEE Signal Process. Lett., vol. 6, no. 12, pp. 300–303, Dec. 1999.

Pizurica, W. Philips, I. Lamachieu, and M. Acheroy, “A joint interand intrascale statistical model for Bayesian wavelet based image denoising,” IEEE Trans. Image Process., vol. 11, no. 5, pp. 545–557, May 2002.

Pizurica and W. Philips, “Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising,” IEEE Trans. Image Process., vol. 15, no. 3, pp. 654–665, Mar. 2006.

J. Liu and P. Moulin, “Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients,” IEEE Trans. Image Process., vol. 10, no. 11, pp. 1647–1658, Nov. 2001.

J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, “Image denoising using scale mixtures of Gaussians in the wavelet domain,” IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338–1351, Nov.2003.

K. Hirakawa and T. W. Parks, “Image denoising for signal-dependent noise,” in Proc. Int. Conf. Acoustics, Speech, Signal Processing, Mar. 2005, vol. 2, pp. 29–32.

K. Hirakawa and T. W. Parks, “Joint demosaicking and denoising,” IEEE Trans. Image Process., vol. 15, no. 8, pp. 2146–2157, Aug. 2006.

S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.

Papoulis, Probability, Random Variables, and Stochastic Processes, 3rd ed. New York: McGraw-Hill, 1991.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.