|
|
|
|
|
|
Prediction of Soluble Solid Content in Apple Using Image Spectral Super-Resolution |
WENG Shi-zhuang, PAN Mei-jing, TAN Yu-jian, ZHANG Qiao-qiao, ZHENG Ling* |
Anhui University,National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Hefei 230601, China
|
|
|
Abstract Apples have a unique flavor, crisp and delicious, and are widely loved by consumers worldwide. Soluble solid content (SSC) is an important internal quality indicator of apples. Hyperspectral imaging (HSI) has been widely used as a non-destructive tool to predict SSC in apples because it can simultaneously acquire spatial and spectral information. However, the widespread application of HSI is hindered due to expensive equipment and time-consuming operations. Spectral super-resolution (SSR) is an efficient way to acquire HSI images by establishing a mapping relationship from low spectral resolution images to corresponding high spectral resolution images. Hence, this study aims to adopt SSR to obtain HSI images from apples RGB images and use the hyperspectral data to predict the SSC of apples. Firstly, the apples of uniform size are selected as samples. Each apple is marked using the black grid matte paper to label the region of interest (ROI), and RGB and HSI images of apples are measured. Then, the global thresholding method generates 220 ROI image pairs of RGB and HSI. Secondly, a dense connection network, a multi-scale hierarchical regression network, and a Transformer network are used to achieve SSR of Apple RGB images to gain HSI images. Finally, the reflectance spectra of HSI images were extracted, and a competitive adaptive reweighted sampling algorithm was applied to obtain the spectra of effective wavelengths (EWs). Partial least squares regression (PLSR), random forest (RF), and extreme learning machine (ELM) are used to predict the SSC of apples by using the full spectra and spectra of EWs. The results show that the Transformer network achieves the best SSR with the mean relative absolute error (MRAESP) of 0.135 9 and the root mean square error (RMSESP) of 0.026 2 in the SSR prediction set, and the spectra obtained after SSR are most consistent with the ground truth. As for the full spectra, ELM provides the best prediction performance for SSC analysis with the coefficient of determination (R2P) of 0.925 5 and root mean square error (RMSEP) of 0.003 in the prediction set. The prediction results of PLSR were relatively poor, and RF performed the worst. When the spectra of EWs are used, tELM obtains the optimal performance R2P=0.960 9 and RMSEP=0.002 2. In contrast, PLSR obtains a slightly poor result and the worst result of estimating SSC is acquired by RF. In conclusion, based on the Transformer image SSR, this article has accomplished the accurate detection of sugar content in apples, offering a low-cost and efficient method for obtaining HSI images. It has realized a rapid and convenient new sugar content detection method, expanding the imaging application scenarios in fruit quality analysis. This provides a theoretical basis for promoting the development of smart agriculture and the food industry.
|
Received: 2023-08-07
Accepted: 2024-01-28
|
|
Corresponding Authors:
ZHENG Ling
E-mail: lingz0865@163.com
|
|
[1] Lee A, Shim J, Kim B, et al. Journal of Food Engineering, 2022, 321: 110945.
[2] GAO Sheng, WANG Qiao-hua(高 升,王巧华). Chinese Optics(中国光学), 2021, 14(3): 566.
[3] Ma T, Xia Y, Inagaki T, et al. Postharvest Biology and Technology, 2021, 174: 111440.
[4] Sharma N, Hefeeda M. Hyperspectral Reconstruction from RGB Images for Vein Visualization. Proceedings of the 11th ACM Multimedia Systems Conference, 2020: 77.
[5] ZHANG Shi-peng, WANG Li-zhi, FU Ying, et al(张仕鹏,王立志,付 莹,等). Chinese Journal of Computers(计算机学报), 2020, 43(1): 151.
[6] LI Yong, JIN Qiu-yu, ZHAO Huai-ci,et al(李 勇,金秋雨,赵怀慈,等). Acta Optica Sinica(光学学报), 2021, 41(7): 0730001.
[7] Shi Z, Chen C, Xiong Z, et al. HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Iamges. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018: 939.
[8] Zhao Y, Po L M, Yan Q, et al. Hierarchical Regression Network for Spectral Reconstruction from RGB Images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020: 422.
[9] Cai Y, Lin J, Lin Z, et al. MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconsturction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2022: 745.
[10] XU Li-jia, CHEN Ming, WANG Yu-chao, et al(许丽佳,陈 铭,王玉超,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2021, 41(7): 2188.
[11] Tian S, Liu W, Xu H. Food Research International, 2023, 170: 112988.
[12] Cheng J, Sun J, Yao K, et al. Journal of the Science of Food and Agriculture, 2023, 103: 2690.
|
[1] |
PENG Bo1, WEN Zhao-yang1, WEN Qi1, LIU Ting-ting1, 2*, XING Shuai3, WU Teng-fei3, YAN Ming1, 2*. Research of Mid-Infrared Time-Stretch Frequency Upconversion
Hyperspectral Imaging System[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(11): 3037-3042. |
[2] |
SHI Rui1, 2, ZHANG Han2, WANG Cheng1, 2, KANG Kai2, LUO Bin1, 2*. Detection of Wheat Single Seed Vigor Using Hyperspectral Imaging and Spectrum Fusion Strategy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(11): 3206-3212. |
[3] |
JIANG Xiao-gang1, 2, HE Cong1, 2, JIANG Nan3, LI Li-sha1, ZHU Ming-wang1, LIU Yan-de1, 2*. Discrimination of Apple Origin and Prediction of SSC Based on
Multi-Model Decision Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(10): 2812-2818. |
[4] |
KONG Li-qin1, 2, NIU Xiao-hu1, 2, WANG Cheng-lei1, 2, FENG Yao-ze1, 2, 3*, ZHU Ming1, 2. Application of Hyperspectral Imaging Technology in the Identification of Composite Adulteration Type in Beef Balls[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(08): 2183-2191. |
[5] |
WANG Hao-yu1, 2, 3, WEI Zi-yuan1, 2, 3, YANG Yong-xia1, 2, 3, HOU Jun-ying1, 2, 3, SUN Zhang-tong1, 2, 3, HU Jin1, 2, 3*. Estimation of Eggplant Leaf Nitrogen Content Based on Hyperspectral Imaging and Convolutional Auto-Encoders Networks[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(08): 2208-2215. |
[6] |
XIAO Nan1, LI Han-lin1, WENG Ding-kang1, HU Dong1, SUN Tong1*, XIONG Yong-sen2. Rapid Identification of Apple Moldy Core Disease by Near Infrared
Spectroscopy With Information Fusion of Different Illumination
Patterns[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(08): 2388-2394. |
[7] |
HUANG Hua1, LIU Ya2, MA Yi-hang1, XIANG Si-han1, HE Jia-ning1, WANG Shi-ting1, GUO Jun-xian3*. Prediction of Soluble Solid Contents in Apples Using Vis-NIRS and
Functional Linear Regression Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(07): 1905-1912. |
[8] |
ZHAO Jia-le1, WANG Guang-long1, ZHOU Bing1*, YING Jia-ju1, LIU Jie1, LIN Chao2, CHEN Qi1, ZHAO Run-ze3. Target Detection Algorithm for Land-Based Hyperspectral Images
Associated With Geospatial Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(07): 2056-2065. |
[9] |
ZHANG Tian-liang1, 2, 3, 4, ZHANG Dong-xing1, 2, CUI Tao1, 2, YANG Li1, 2*, XIE Chun-ji1, 2, DU Zhao-hui1, 2, XIAO Tian-pu1, 2. Study on Nondestructive Testing of Corn Stalk Strength in Different
Periods[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(06): 1703-1709. |
[10] |
WANG Zi-xuan1, YANG Liang2, 3, 4*, HUANG Ling-xia2, HE Yong4, ZHAO Li-hua3, ZHAN Peng-fei3. Nondestructive Determination of TSS Content in Postharvest Mulberry Fruits Using Hyperspectral Imaging and Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(06): 1724-1730. |
[11] |
YANG Zeng-rong1, 2, WANG Huai-bin1, 2, TIAN Mi-mi1, 2, LI Jun-hui1, 2, ZHAO Long-lian1, 2*. Early Apple Bruise Detection Based on Near Infrared Spectroscopy and Near Infrared Camera Multi-Band Imaging[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(05): 1364-1371. |
[12] |
SONG Shao-zhong1, LIU Yuan-yuan2, ZHOU Zi-yang3, TENG Xing3, LI Ji-hong3, LIU Jun-ling1, GAO Xun2*. Identification of Sorghum Breed by Hyperspectral Image Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(05): 1392-1397. |
[13] |
XIE Bai-heng1, MA Jin-fang1, ZHOU Yong-xin1, HAN Xue-qin1, CHEN Jia-ze1, ZHU Si-qi1, YANG Mao-xun2, 3*, HUANG Fu-rong1*. Identification of Citri Grandis Fructus Immaturus Based on Hyperspectral Combined With HHO-KELM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(05): 1494-1500. |
[14] |
JIANG Yue-peng, CAO Yun-hua*, WU Zhen-sen, CAO Yi-sen, HU Sui-jing. Measurement of Mid-Wave Infrared Hyperspectral Imaging
Characteristics of Ground Targets[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(04): 937-944. |
[15] |
ZHANG Fu1, 2, YU Huang1, XIONG Ying3, ZHANG Fang-yuan1, WANG Xin-yue1, LÜ Qing-feng4, WU Yi-ge4, ZHANG Ya-kun1, FU San-ling5*. Hyperspectral Non-Destructive Detection of Heat-Damaged Maize Seeds[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(04): 1165-1170. |
|
|
|
|