Abstract:For the cucumber harvesting robot, the identification of target information is one of important tasks in the automation of fruit-picking. In order to implement spatial fruit localization and quality discrimination in greenhouse, this paper presented a machine vision algorithm for the recognition and detection of cucumber fruits based on near-infrared spectral imaging. By comparing the spectral reflectance of cucumber plant (fruit, leaf and stem) from visible to infrared region (325-1 075 nm) measured by ASD FieldSpec Pro VNIR spectrometer, a monospectral near-infrared image at the 850 nm sensitive wavelength was captured to cope with the similar-color segmentation problem in complex environment. Then, a method of fruit extraction was developed on the basis of the following steps. Firstly, from the gray level histogram it was observed that the pixels of fruit distributed on the right are lesser than that of background, so “P parameter threshold method” was used to image segmentation. Subsequently, divided local image was partitioned into several sub-blocks by the application of adaptive template mining, which was feasible for processing the fruit with long-column feature. Finally, noises including parts of stem and leaf were eliminated using estimation condition of barycentre position and area size, proved by relative experiment. In addition, the region for robotic grasping was established by gray variation between fruit-handle and fruit pedicel, as the quality feature was extracted with morphological characteristics of the centre-line length and the fruit flexure degree. A detecting experiment was carried out on 30 images with cucumber fruits and 10 images with no fruits, which were taken in a changing greenhouse environment. The results indicate that the accuracy rate of the recognition was 83.3% and 100%, while the success rate of effectively acquiring the grasping region was 83.3%, which can meet the demand of robotic fruit-harvesting.
Key words:Machine vision;Cucumber in greenhouse;NIR image;Image recognition
袁 挺,许晨光,任永新,冯青春,谭豫之,李 伟* . 基于近红外图像的温室环境下黄瓜果实信息获取[J]. 光谱学与光谱分析, 2009, 29(08): 2054-2058.
YUAN Ting, XU Chen-guang, REN Yong-xin, FENG Qing-chun, TAN Yu-zhi, LI Wei* . Detecting the Information of Cucumber in Greenhouse for Picking Based on NIR Image . SPECTROSCOPY AND SPECTRAL ANALYSIS, 2009, 29(08): 2054-2058.
[1] Tabb A L, Peterson D L, Park J. 2006 ASABE Annual International Meeting, 2006, Qaper No: 063060. [2] Bulanon D M, Kataoka T, Ota Y, et al. Biosystems Engineering, 2002, 83(4): 405. [3] Chinchuluun R, Lee W S. 2006 ASABE Annual International Meeting, 2006, Paper No: 063010. [4] Hannan M W,Burks T F,Bulanon D M. 2007 ASABE Annual International Meeting, 2007, Paper No: 073125. [5] Kondo N, Ninomiya K, Hayashi S, et al. 2005 ASAE Annual International Meeting. 2005, Paper No: 053018. [6] Lim Siroratana S, Ikeda Y. 2002 SICE Annual Conference Japan, 2002, 1336. [7] Kane Kevin E, Lee Won Suk. 2007 ASABE Annual International Meeting, 2007, Paper No: 073025. [8] Brivot R, Marchant J A. IEEE Proceedings-Vision Image and Signal Processing, 1996, 143(02): 118. [9] Wen Z, Tao Y. Transactions of the ASAE, 2000, 43(2): 449. [10] Ariana D P, Lu Renfu. American Society of Agricultural Engineers, 2006, Paper No: 063039. [11] Kondo N, Chong V K, Ninomiya K, et al. American Society of Agricultural and Biological Engineers, 2005, Paper No: 056073. [12] Lu R. Trans. American Society of Agricultural Engineers, 2003, 46(2): 523. [13] Mahesh S, Manickavasagan A, Jayas D S, et al. 2007 ASABE Annual International Meeting, 2007, Paper No: 072835. [14] Kondo N, Nakamura H, Monta M, et al. Proceedings of the Food Processing Automation Conference Ⅲ, 1994. 461. [15] Arlma Seiichi, Kondo Naoshi, Shibaxo Yasunori. Journal of the Japanese Society of Agriculture Machinery, 1994, 57(1): 51. [16] Van Henten E J, Hemming J, van Tuijl B A J, et al. Autonomous Robots, 2002, 13(3): 241. [17] Van Henten E J, van Tuijl B A J, Hoogaker G J, et al. Biosystems Engineering, 2006, 94(3): 317. [18] ZHANG Xi-jie, LI Min-zan, CUI Di, et al(张喜杰,李民赞,崔 笛,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2006, 26(5): 887. [19] ZHU Deng-sheng, PAN Jia-zhi, HE Yong(朱登胜,潘家志,何 勇). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2008, 28(5): 1102. [20] FANG Ru-ming, CAI Jian-rong, XU Li(方如明,蔡健荣,许 俐). Computer Image Processing Technology and Its Applications in Agriculture Engineering(计算机图像处理技术及其在农业工程中的应用). Beijing: Tsinghua University Press(北京:清华大学出版社),1999. [21] Arlma Seiichi, Kondo Naoshi, Shibaxo Yasunori. Journal of the Japanese Society of Agriculture Machinery, 1994, 56(6): 69.