光谱学与光谱分析 |
|
|
|
|
|
Detecting the Information of Cucumber in Greenhouse for Picking Based on NIR Image |
YUAN Ting, XU Chen-guang, REN Yong-xin, FENG Qing-chun, TAN Yu-zhi, LI Wei* |
College of Engineering, China Agricultural University, Beijing 100083, China |
|
|
Abstract For the cucumber harvesting robot, the identification of target information is one of important tasks in the automation of fruit-picking. In order to implement spatial fruit localization and quality discrimination in greenhouse, this paper presented a machine vision algorithm for the recognition and detection of cucumber fruits based on near-infrared spectral imaging. By comparing the spectral reflectance of cucumber plant (fruit, leaf and stem) from visible to infrared region (325-1 075 nm) measured by ASD FieldSpec Pro VNIR spectrometer, a monospectral near-infrared image at the 850 nm sensitive wavelength was captured to cope with the similar-color segmentation problem in complex environment. Then, a method of fruit extraction was developed on the basis of the following steps. Firstly, from the gray level histogram it was observed that the pixels of fruit distributed on the right are lesser than that of background, so “P parameter threshold method” was used to image segmentation. Subsequently, divided local image was partitioned into several sub-blocks by the application of adaptive template mining, which was feasible for processing the fruit with long-column feature. Finally, noises including parts of stem and leaf were eliminated using estimation condition of barycentre position and area size, proved by relative experiment. In addition, the region for robotic grasping was established by gray variation between fruit-handle and fruit pedicel, as the quality feature was extracted with morphological characteristics of the centre-line length and the fruit flexure degree. A detecting experiment was carried out on 30 images with cucumber fruits and 10 images with no fruits, which were taken in a changing greenhouse environment. The results indicate that the accuracy rate of the recognition was 83.3% and 100%, while the success rate of effectively acquiring the grasping region was 83.3%, which can meet the demand of robotic fruit-harvesting.
|
Received: 2008-08-08
Accepted: 2008-11-12
|
|
Corresponding Authors:
LI Wei
E-mail: liww@cau.edu.cn
|
|
[1] Tabb A L, Peterson D L, Park J. 2006 ASABE Annual International Meeting, 2006, Qaper No: 063060. [2] Bulanon D M, Kataoka T, Ota Y, et al. Biosystems Engineering, 2002, 83(4): 405. [3] Chinchuluun R, Lee W S. 2006 ASABE Annual International Meeting, 2006, Paper No: 063010. [4] Hannan M W,Burks T F,Bulanon D M. 2007 ASABE Annual International Meeting, 2007, Paper No: 073125. [5] Kondo N, Ninomiya K, Hayashi S, et al. 2005 ASAE Annual International Meeting. 2005, Paper No: 053018. [6] Lim Siroratana S, Ikeda Y. 2002 SICE Annual Conference Japan, 2002, 1336. [7] Kane Kevin E, Lee Won Suk. 2007 ASABE Annual International Meeting, 2007, Paper No: 073025. [8] Brivot R, Marchant J A. IEEE Proceedings-Vision Image and Signal Processing, 1996, 143(02): 118. [9] Wen Z, Tao Y. Transactions of the ASAE, 2000, 43(2): 449. [10] Ariana D P, Lu Renfu. American Society of Agricultural Engineers, 2006, Paper No: 063039. [11] Kondo N, Chong V K, Ninomiya K, et al. American Society of Agricultural and Biological Engineers, 2005, Paper No: 056073. [12] Lu R. Trans. American Society of Agricultural Engineers, 2003, 46(2): 523. [13] Mahesh S, Manickavasagan A, Jayas D S, et al. 2007 ASABE Annual International Meeting, 2007, Paper No: 072835. [14] Kondo N, Nakamura H, Monta M, et al. Proceedings of the Food Processing Automation Conference Ⅲ, 1994. 461. [15] Arlma Seiichi, Kondo Naoshi, Shibaxo Yasunori. Journal of the Japanese Society of Agriculture Machinery, 1994, 57(1): 51. [16] Van Henten E J, Hemming J, van Tuijl B A J, et al. Autonomous Robots, 2002, 13(3): 241. [17] Van Henten E J, van Tuijl B A J, Hoogaker G J, et al. Biosystems Engineering, 2006, 94(3): 317. [18] ZHANG Xi-jie, LI Min-zan, CUI Di, et al(张喜杰,李民赞,崔 笛,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2006, 26(5): 887. [19] ZHU Deng-sheng, PAN Jia-zhi, HE Yong(朱登胜,潘家志,何 勇). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2008, 28(5): 1102. [20] FANG Ru-ming, CAI Jian-rong, XU Li(方如明,蔡健荣,许 俐). Computer Image Processing Technology and Its Applications in Agriculture Engineering(计算机图像处理技术及其在农业工程中的应用). Beijing: Tsinghua University Press(北京:清华大学出版社),1999. [21] Arlma Seiichi, Kondo Naoshi, Shibaxo Yasunori. Journal of the Japanese Society of Agriculture Machinery, 1994, 56(6): 69.
|
[1] |
SHENG Qiang1, 2, ZHENG Jian-ming1*, LIU Jiang-shan2, SHI Wei-chao1, LI Hai-tao2. Advances and Prospects in Inner Surface Defect Detection Based on Cite Space[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 9-15. |
[2] |
LIU You-fu, XIAO De-qin*, WANG Chun-tao. Fertilized Eggs’ Air-Cell Change Monitoring Algorithm Based on Thermal-Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 572-578. |
[3] |
ZHANG Ling-xian1, TIAN Xiao1, LI Yun-xia1, CHEN Yun-qiang1, CHEN Ying-yi1, MA Jun-cheng2*. Estimation of Disease Severity for Downy Mildew of Greenhouse Cucumber Based on Visible Spectral and Machine Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(01): 227-232. |
[4] |
KONG De-ming1, 4, CUI Yao-yao2*, KONG Ling-fu2, WANG Shu-tao1, SHI Hui-chao3. The Application of Digital Image Recognition to the Analysis of Three-Dimensional Fluorescence Spectra of Mixed Oil[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(11): 3407-3413. |
[5] |
CAO Yu-ting1, ZHAO Zhong1*, YUAN Hong-fu2, LI Bin1. Edible Oil Classification Based on Molecular Spectra Analysis with Image Recognition[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 659-664. |
[6] |
ZHOU Meng-ran1, LAI Wen-hao1*, WANG Ya1, 2, HU Feng1, LI Da-tong1, WANG Rui1. Application of CNN in LIF Fluorescence Spectrum Image Recognition of Mine Water Inrush[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(07): 2262-2266. |
[7] |
MA Jun-cheng1, DU Ke-ming1*, ZHENG Fei-xiang1, ZHANG Ling-xian2, SUN Zhong-fu1. A Segmenting Method for Greenhouse Cucumber Downy Mildew Images Based on Visual Spectral and Support Vector Machine[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(06): 1863-1868. |
[8] |
ZHU Xian-feng1,2, JIAO Bin1,2, ZHAO Jing3, LI Gang1,2, LIN Ling1,2* . Improving the Accuracy of Camera-Based Heart Rate Measurement [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(02): 651-658. |
[9] |
ZHENG Ling1, 2, ZHU Da-zhou3, DONG Da-ming1, ZHANG Bao-hua1,WANG Cheng1, ZHAO Chun-jiang1*. Monitoring of Winter Wheat Aboveground Fresh Biomass Based on Multi-Information Fusion Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(06): 1818-1825. |
[10] |
ZHANG Bao-hua1, 2, HUANG Wen-qian2, LI Jiang-bo2, ZHAO Chun-jiang1, 2*, LIU Cheng-liang1, HUANG Dan-feng1, GONG Liang1. Detection of Slight Bruises on Apples Based on Hyperspectral Imaging and MNF Transform [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(05): 1367-1372. |
[11] |
WANG Dong1, 3, MA Zhi-hong2, ZHAO Liu2, PAN Li-gang2, LI Xiao-ting2, WANG Ji-hua1, 2* . Comparative Research on the NIR and MIR Micro-Imaging of Two Similar Plastic Materials[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(09): 2377-2382. |
|
|
|
|