|
|
|
|
|
|
Visualization Analysis of Crop Spectral Index Based on RGB-NIR Image Matching |
SUN Hong, XING Zi-zheng, ZHANG Zhi-yong, MA Xu-ying, LONG Yao-wei, LIU Ning, LI Min-zan* |
Key Laboratory of Modern Precision Agriculture System Integration Research, Ministry of Education, China Agricultural University, Beijing 100083, China |
|
|
Abstract The NDVI (Normalized Difference Vegetation Index) calculated based on the spectral reflectance is proved as one of the important parameters to estimate the chlorophyll content of crops, which indicates the growth condition of crop quickly and nondestructively. Thus, the distribution of NDVI of crops can be studied by the binocular stereo vision system with visible RGB (Red, Green, Blue) and near infrared (NIR) images. And the NDVI distribution and dynamics of crops are monitored through the image analysis at different angles. After the spatial distribution maps of crop vegetation index were established based on the matching of RGB and NIR images, the spatial distribution characteristics and influencing factors were discussed by the visualization of NDVI. The RGB and NIR images of 51 maize plants were collected synchronously by the binocular stereo vision system at 90°,54°,35° respectively. The RGB-NIR images were pre-processed by Gauss filtering and Laplace operator enhancement. Firstly, three algorithms, namely, SURF (Speeded-Up Robust Features), SIFT (Scale-invariant Feature Transform) and ORB (Oriented Brief), were studied and discussed for RGB-NIR image matching and alignment. Four evaluation indices wereused to determine the optimal matching methodfor RGB-NIR image matching and alignment, including matching time, PSNR (Peak Signal to NoiseRatio), MI (Mutual Information) and SSIM (Structural Similarity Index). Secondly, the crop and background were segmented by using ExG (Extra Green) algorithm and Maximum Interclass Variance algorithm (OTSU). The R (Red), G (Green), B (Blue) and NIR components of the segmented RGB images were extracted. The influence of illumination was discussed and Spectral reflectance was corrected based on the I component of HSI (Hue-Saturation-Intensity) color model. Then, the NDVI of each pixel in the image was calculated, the spatial distribution map of crop vegetation index was drawn, and the distribution characteristics of NDVI under different shooting angles were compared and analyzed. The NDVI distribution was used to display the chlorophyll distribution of crop plants. The RGB-NIR image matching results showed that the matching time with SIFT (1.865 s)>SURF (1.412 s)>ORB (1.121 s), the matching accuracy with SURF≈SIFT>ORB, and the matching stability with SURF≈SIFT>ORB. According to discussion results, the SURF algorithm was selected as the optimal matching algorithm. In order to eliminate the influence of ambient light, the image reflectance was corrected by 4 gray level standard plates on the basis of discussing the I component and gray histogram of HSI model. The R2 of R, G, B and NIR component correction models were 0.78,0.76,0.74 and 0.77 respectively. The vegetation index distributions of leaves and stems of crops were presented from 90 and 35 angles, which could provide new technical support for analyzing and monitoring the nutritional status and distribution of crops.
|
Received: 2019-02-28
Accepted: 2019-06-02
|
|
Corresponding Authors:
LI Min-zan
E-mail: limz@cau.edu.cn
|
|
[1] Lu X, Lu S. International Journal of Remote Sensing, 2015, 36(5): 1447.
[2] WANG Zhi-chao, WANG Jian-jun, DAI Xiao-yu, et al(王志超, 王建军, 戴晓宇, 等). Agriculture of Jilin(吉林农业), 2018, (24): 53.
[3] REN Jian-qiang, WU Shang-rong, LIU Bin(任建强, 吴尚蓉, 刘 斌). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2018, 49(4): 199.
[4] ZHAO Chun-hui, QI Bin, Youn E(赵春晖, 齐 滨, Youn E). Journal of Infrared and Millimeter Wave(红外与毫米波学报), 2013, 32(1): 62.
[5] NIU Ya-xiao, ZHANG Li-yuan, HAN Wen-ting, et al(牛亚晓, 张立元, 韩文霆, 等). Transactions of the Chinese Society for Agricultural Machinery(农业机械学报), 2018, 49(4): 212.
[6] LIU Ke, ZHOU Qing-bo, WU Wen-bin, et al(刘 轲, 周清波, 吴文斌, 等). Transactions of the Chinese Society of Agricultural Engineering(农业工程学报), 2016, 32(3): 155.
[7] AvinashA, Snehasish D G. Computers and Electronics in Agriculture, 2018, 152: 281.
[8] Firmenich D, Brown M, Susstrunk S. IEEE International Conference on Image Processing. IEEE, 2011.
[9] TAN Xiang, MAO Hai-ying, ZHI Xiao-dong, et al(谭 翔, 毛海颖, 支晓栋, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2018, 38(2): 413.
[10] JI Hua, WU Yuan-hao, SUN Hong-hai, et al(纪 华, 吴元昊, 孙宏海, 等). Optics and Precision Engineering(光学精密工程), 2009, 17(2): 439.
[11] Rublee E, Rabaud V, Konolige K, et al. International Conference on Computer Vision. IEEE,2011.
[12] Ding W, Bi D, He L, et al. Infrared Physics & Technology, 2018, 92: 372. |
[1] |
ZHU Wen-jing1, 2,FENG Zhan-kang1, 2,DAI Shi-yuan1, 2,ZHANG Ping-ping3,JI Wen4,WANG Ai-chen1, 2,WEI Xin-hua1, 2*. Multi-Feature Fusion Detection of Wheat Lodging Information Based on UAV Multispectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 197-206. |
[2] |
SHENG Qiang1, 2, ZHENG Jian-ming1*, LIU Jiang-shan2, SHI Wei-chao1, LI Hai-tao2. Advances and Prospects in Inner Surface Defect Detection Based on Cite Space[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 9-15. |
[3] |
GAO Shi-jiao1, GUAN Hai-ou1*, MA Xiao-dan1, WANG Yan-hong2. Soybean Canopy Extraction Method Based on Multispectral Image Processing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3568-3574. |
[4] |
FAN Xian-guang1, 2, HUANG Yan-rui1, LIU Long1, XU Ying-jie1, WANG Xin1, 2*. An Interpolation Method for Raman Imaging Using Voigt Function[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1478-1483. |
[5] |
MA Xiao-dan1*, LIU Meng1, GUAN Hai-ou1, WEN Feng-rui1, LIU Gang2. Recognition Method for Crop Canopies Based on Thermal Infrared Image Processing Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 216-222. |
[6] |
LI Zhen-bo1, 2, 3, NIU Bing-shan1, PENG Fang1, LI Guang-yao1. Estimation Method of Fry Body Length Based on Visible Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(04): 1243-1250. |
[7] |
SHENG Zhen-fei1, ZHANG Chun-guang1*, QIU Ze-long1, WANG Hao1, 2*, ZHANG Xiao-fa1, HUANG Xi1, TAN Zhi-wei1, QIU Wei-jie1, WANG Peng-chong1, 2*, LIU Wen-yao3, DUAN Mao-qiang1, 4, HUANG Xiao-li1, 5, HUANG Zu-fang1, LIU Yi-ping1, XING Yu-wei1, LIN Bin-bin1. Spectroscopic Imaging of Cutaneous Squamous Cell Carcinoma Based on Acousto-Optic Filtering[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(01): 34-40. |
[8] |
SUN Hong1, XING Zi-zheng1, QIAO Lang1, LONG Yao-wei1, GAO De-hua1, LI Min-zan1*, Qin Zhang2. Spectral Imaging Detection of Crop Chlorophyll Distribution Based on Optical Saturation Effect Correction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(12): 3897-3903. |
[9] |
YIN Lu1, 2,Bayanheshig1*,YAO Xue-feng1,CUI Ji-cheng1,ZHU Ji-wei1,ZHANG Rui1, 2. Algorithm for Background Removal in Spectral Image of Echelle Spectrometer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(06): 1925-1929. |
[10] |
ZHAO Min-jie1, ZOU Ying2, SI Fu-qi1*, LU Yi-huai1, WANG Yu1, WANG Shi-mei1, ZHOU Hai-jin1, ZENG Yi1, LIU Wen-qing1. Study on the Non-Uniformity Calibration of Space-Born Differential Optical Absorption Spectrometer[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(09): 2578-2582. |
[11] |
MA Liang, WEI Jun, HUANG Xiao-xian . Research on and Correction of Interference Fringes Phenomenon in Dispersive Hyperspectral Imaging Spectrometer Using Back-Illuminated CCDs in Near-Infrared Band[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(07): 1995-1999. |
[12] |
WANG Xin, ZHANG Xiao-dong . Laser and Vision Measurement Research on Parameters of Miniature Quartz Plate-Sensitive Glass Part [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(06): 1450-1455. |
[13] |
YANG Wei1, Nick Sigrimis2, LI Min-zan1* . Nitrogen Content Testing and Diagnosing of Cucumber Leaves Based on Multispectral Imagines [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2010, 30(01): 210-213. |
[14] |
DUO Hua-qiong, WANG Xi-ming* . Analysis of Cell Arrangements in Biota Orientalis Using Fourier Transformation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2009, 29(10): 2654-2656. |
[15] |
DUO Hua-qiong, WANG Xi-ming. Study of the Fiber Size in Hardwood Using Fourier Transform [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2009, 29(09): 2379-2382. |
|
|
|
|