|
|
|
|
|
|
| Research on Near Infrared and Color Visible Fusion Based on PCNN in Transform Domain |
| SHEN Yu, YUAN Yu-bin*, PENG Jing |
| School of Electronic and Information Engineering，Lanzhou Jiaotong University，Lanzhou 730070，China |
|
|
|
|
Abstract Aiming at the problems of low contrast, loss of detail and color distortion after fusion of near-infrared and color visible images, a new fusion algorithm of infrared and color visible images based on multi-scale transformation and adaptive pulse coupled neural network (PCNN) is proposed. Firstly, the visible color image is transformed into HSI (Hue Saturation Intensity) space. HSI color space contains three components: brightness, chroma and saturation, and these three components are not correlated with each other. Therefore, using this feature, the three components can be processed separately. The brightness component and the near-infrared image are transformed by multi-scale transformation, respectively. Tetrolet transform is chosen as the transformation method. After transformation, the low-frequency and high-frequency components are obtained, respectively. For the low-frequency components of the image, a fusion rule with the highest expectation is proposed. For the high-frequency components of the image, the threshold of the PCNN model is adjusted by the Gauss difference operator, and an adaptive PCNN model is proposed as the fusion rule. The fused image of the processed high and low frequency components through Tetrolet inverse transformation is used as a new brightness image. Then, the new brightness image and the original chromaticity and saturation components are mapped to RGB space, and the fused color image is obtained. In order to solve the problem of image smoothing and uneven illumination of the original image, a color and sharpness correction mechanism (CSC) is introduced to improve the quality of the fused image. In order to verify the effectiveness of the proposed method, five groups of near-infrared and color visible images with the resolution of 1 024×680 were selected for experiments and compared with four current efficient fusion methods and the method without color correction. The experimental results show that, compared with other image fusion algorithms, this method can retain the most details and textures with or without CSC color, and the visibility is greatly improved. At the same time, the results of this method have more details and textures under weak illumination conditions and have better contrast and good quality. Good color reproduction. It has great advantages in information retention, color restoration, image contrast and structural similarity.
|
|
Received: 2019-09-27
Accepted: 2020-04-09
|
|
|
|
Corresponding Authors:
YUAN Yu-bin
E-mail: 164821193@qq.com
|
|
[1] Ding W S，Bi D Y，He L Y, et al. Infrared Physics & Technology，2018, 92: 372.
[2] Li J, Song M H, Peng Y X. Infrared Physics & Technology，2018, 89: 129.
[3] Liu C H, Qi Y, Ding W R. Infrared Physics & Technology，2017, 83: 94.
[4] Sharma V, Hardeberg J Y, George S. Journal of Imaging Science & Technology，2017, 61(4): 1.
[5] Huang Y, Bi D Y, Wu D P. Sensors, 2018, 18(4): 1169.
[6] Su H, Jung C. Multi-Spectral Fusion and Denoising of RGB and NIR Images Using Multi-Scale Wavelet Analysis. 2018 24th International Conference on Pattern Recognition，2018. 1779.
[7] Bavirisetti D P, Dhuli R. Infrared Physics & Technology，2016, 76: 52.
[8] Krommweh J. Journal of Visual Communication and Image Representation，2010, 21(4): 364.
[9] Nemalidinne S M, Gupta D. Fire Safety Journal，2018, 101: 84.
[10] Wu F，Kin Tak U. Low-Light Image Enhancement Algorithm Based on HSI Color Space. 2017 10th International Congress on Image and Signal Processing. BioMedical Engineering and Informatics, 2017. 1.
[11] Mittel V, Singh D, Saini L M. A Comparative Analysis of Supervised Land Cover Classification Using Multi-Polarized PALSAR EM Image Fusion. International Conference on Industrial & Information Systems，2014. 1.
[12] Sun Q, Zhang S, Cao L, et al. Visual Tracking Algorithm by Particle Filter and EM Based on Multi-Cues. 2016 IEEE International Conference on Information and Automation，2016. 1850.
[13] Cheng B Y, Jin L X, Li G N. Neurocomputing. 2018, 310: 135. |
| [1] |
LIU Jia-ni, JIN Wei-qi*, LI Li, WANG Xia . Visible and Infrared Thermal Image Fusion Algorithm Based on Self-Adaptive Reference Image [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(12): 3907-3914. |
| [2] |
SHEN Yu1, DANG Jian-wu1, FENG Xin2, WANG Yang-ping1, HOU Yue1 . Infrared and Visible Images Fusion Based on Tetrolet Transform [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33(06): 1506-1511. |
|
|
|
|
