An Effective Image Demosaicking Algorithm with Correlations among RGB Channels

Authors

School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai, China

Abstract

In this paper, an effective image demosaicking algorithm, which is based on the correlation among the three primary colors, is proposed for mosaic image with Bayer color filter array (CFA). To reduce the distortion and improve the reconstruction quality, the proposed interpolation method makes full use of the brightness information and the edge information. We design several filters with size of 5×5, 3×5, and 5×3 firstly, and then improve the bilinear algorithm with a correction value. Simulations on 24 Kodak photos demonstrate that our proposed method outperforms the other two methods in average composite peak signal-to-noise ratio (CPSNR) and visual perception. The biggest advantage of the proposed method is that it fully utilizes the correlation among RGB channels.

Keywords


1.     Bayer, B.E., Color imaging array. (1976), Google Patents.
2.     Menon, D. and Calvagno, G., "Color image demosaicking: An overview", Signal Processing: Image Communication,  Vol. 26, No. 8, (2011), 518-533.
3.     Adams Jr, J.E., "Interactions between color plane interpolation and other image processing functions in electronic photography", in IS&T/SPIE's Symposium on Electronic Imaging: Science & Technology, International Society for Optics and Photonics., (1995), 144-151.
4.     Longere, P., Zhang, X., Delahunt, P.B. and Brainard, D.H., "Perceptual assessment of demosaicing algorithm performance", Proceedings of the IEEE,  Vol. 90, No. 1, (2002), 123-132.
5.     Yu, W., "Colour demosaicking method using adaptive cubic convolution interpolation with sequential averaging", IEE Proceedings-Vision, Image and Signal Processing,  Vol. 153, No. 5, (2006), 666-676.
6.     Malvar, H.S., He, L.-w. and Cutler, R., "High-quality linear interpolation for demosaicing of bayer-patterned color images", in Acoustics, Speech, and Signal Processing, Proceedings.(ICASSP'04). IEEE International Conference on, IEEE. Vol. 3, (2004), 485-488.
7.     Gunturk, B.K., Altunbasak, Y. and Mersereau, R.M., "Color plane interpolation using alternating projections", IEEE Transactions on Image Processing,  Vol. 11, No. 9, (2002), 997-1013.
8.     Luo, X., Sun, H., Chen, Q., Chen, J. and Wang, Y.-j., "Real-time demosaicing of bayer pattern images", Chinese J. Opt. Appl. Opt,  Vol. 3, No. 2, (2010), 182-187.
9.     Wang, D., Yu, G., Zhou, X. and Wang, C., "Image demosaicking for bayer-patterned CFA images using improved linear interpolation", in Information Science and Technology (ICIST), Seventh International Conference on, IEEE., (2017), 464-469.
10.   Adams Jr, J.E. and Hamilton Jr, J.F., Adaptive color plane interpolation in single sensor color electronic camera. (1997), Google Patents.
11.   Zhang, L., Wu, X., Buades, A. and Li, X., "Color demosaicking by local directional interpolation and nonlocal adaptive thresholding", Journal of Electronic Imaging,  Vol. 20, No. 2, (2011), 023016.
12.   Chen, X., He, L., Jeon, G. and Jeong, J., "Multidirectional weighted interpolation and refinement method for bayer pattern CFA demosaicking", IEEE Transactions on Circuits and Systems for Video Technology,  Vol. 25, No. 8, (2015), 1271-1282.
13.   Shi, J., Wang, C. and Zhang, S., "Region-adaptive demosaicking with weighted values of multidirectional information", Journal of Communications,  Vol. 9, No. 12, (2014), 930-936.
14.   Yun, Y., Bae, J. and Kim, J., "Multidirectional edge-directed interpolation with region division for natural images", Optical Engineering,  Vol. 51, No. 4, (2012), 040503.
15.   Chen, W.-J. and Chang, P.-Y., "Effective demosaicking algorithm based on edge property for color filter arrays", Digital Signal Processing,  Vol. 22, No. 1, (2012), 163-169.
16.   Song, Z., Wang, D., Huang, Z. and Pang, Y., "Edge pattern based demosaicking algorithm of color filter array", Transactions of Tianjin University,  Vol. 19, No. 1, (2013), 29-36.
17.   Kiku, D., Monno, Y., Tanaka, M. and Okutomi, M., "Residual interpolation for color image demosaicking", in Image Processing (ICIP), 20th IEEE International Conference on, IEEE., (2013), 2304-2308.
18.   Pekkucuksen, I. and Altunbasak, Y., "Gradient based threshold free color filter array interpolation", in Image Processing (ICIP), 17th IEEE International Conference on, IEEE., (2010), 137-140.
19.   Kiku, D., Monno, Y., Tanaka, M. and Okutomi, M., "Beyond color difference: Residual interpolation for color image demosaicking", IEEE Transactions on Image Processing,  Vol. 25, No. 3, (2016), 1288-1300.
20.   Wang, L. and Jeon, G., "Bayer pattern CFA demosaicking based on multi-directional weighted interpolation and guided filter", IEEE Signal Processing Letters,  Vol. 22, No. 11, (2015), 2083-2087.
21.   Franzen, R., Kodak lossless true color image suite: PhotoCD PCD0992. (2002), Mar.