|
|
|
|
|
|
| Attention Mechanism Based Hyperspectral Image Dimensionality Reduction for Mold Spot Recognition in Paper Artifacts |
| TANG Bin1, HE Yu-long1, TANG Huan2*, LONG Zou-rong1, WANG Jian-xu1*, TAN Bo-wen2, QIN Dan2, LUO Xi-ling1, ZHAO Ming-fu1 |
1. Chongqing University of Technology, Chongqing Key Laboratory of Fiber Optic Sensing and Photoelectric Detection, Chongqing 400054, China
2. Key Scientific Research Base of Pest and Mold Control of Heritage Collection (Chongqing China Three Gorges Museum), National Cultural Heritage Administration, Chongqing 400060, China
|
|
|
|
|
Abstract Paper cultural relics are important for heritage transmission as they record human history and humanities in different periods. However, they are highly susceptible to microorganisms such as mold during preservation. Mold can accelerate the degradation of cellulose, generating mold on the surface of paper. Scattered spores can spread widely with airflow, increasing the risk of mold on other paper cultural relics. Regular mold spot detection is crucial for understanding paper artifacts' status and restoration. Hyperspectral imaging technology is a non-contact and non-destructive detection method that simultaneously obtains spatial and spectral data. This technology can be combined with computer technology to enable large batches of real-time, non-destructive testing of paper cultural relics. This paper proposes a method for reducing the dimensionality of hyperspectral data for Aspergillus niger, a commonly occurring mold. The method is based on the attention mechanism and allows for adaptive preprocessing of hyperspectral redundant data. This paper reports on the collection of 20 samples of Aspergillus niger, mold spots on paper artifacts provided by the Chongqing China Three Gorges Museum. The average spectral curves of the infected and healthy areas are analyzed using ENVI software in the 413~855 and 855~1 021nm bands. The results showed a significant difference in average reflectance between the two areas. The paper compares the proposed method with traditional principal component analysis and independent component analysis preprocessing methods for processing original hyperspectral data. The results are then experimented on four semantic segmentation networks: classical U-Net, SegNet, DeepLabV3+, and PSPNet. The experimental results demonstrate that the preprocessed data produced by the algorithm presented in this paper exhibit significant advantages over the classical U-Net and SegNet networks. Furthermore, compared to the principal component analysis method and independent component analysis method, the accuracy of mold spot identification has improved significantly by 89.49% and 88.46%, respectively. These results confirm the effectiveness of the proposed algorithm and provide valuable support and new ideas for the field of cultural relics protection.
|
|
Received: 2023-11-21
Accepted: 2024-04-24
|
|
|
|
Corresponding Authors:
TANG Huan, WANG Jian-xu
E-mail: wangjianxu@cqut.edu.cn; tanghuan3gm@163.com
|
|
[1] Cortesão M, de Haas A, Unterbusch R, et al. Frontiers in Microbiology, 2020, 11: 560.
[2] Caselli E, Pancaldi S, Baldisserotto C, et al. PLoS One, 2018, 13(12): e0207630.
[3] CHEN Jia-li, LIU Xing-xing, HAN Qiu-lin, et al(陈佳丽, 刘星星, 韩秋琳, 等). Cultural Relics World(文物天地), 2023，(12): 81.
[4] Boniek D, Bonadio L, Damaceno Q S, et al. Canadian Journal of Microbiology, 2020, 66(10): 586.
[5] ZHANG Nuo, XU Sen(张 诺, 徐 森). Sciences of Conservation and Archaeology(文物保护与考古科学), 2020, 32(1): 77.
[6] ZHANG Nuo, CHEN Xiao-li, DING Li-ping, et al(张 诺, 陈潇俐, 丁丽平, 等). Journal of Nanjing University of Technology(Natural Science Edition)[南京工业大学学报(自然科学版)], 2022, 44(4): 450.
[7] Apacionado B V, Ahamed T. Sensors, 2023, 23(20): 8519.
[8] Jung D H, Kim J D, Kim H Y, et al. Frontiers in Plant Science, 2022, 13: 837020.
[9] Yuan D, Jiang J, Qi X, et al. Infrared Physics & Technology, 2020, 111: 103518.
[10] Cong S, Sun J, Mao H, et al. Journal of the Science of Food and Agriculture, 2018, 98(4): 1453.
[11] Treepong P, Theera-Ampornpunt N. Current Research in Food Science, 2023, 7: 100574.
[12] Solórzano J V, Mas J F, Gao Y, et al. Remote Sensing, 2021, 13(18): 3600.
[13] Wang J, Liu W, Gou A. Urban Forestry & Urban Greening, 2022, 69: 127488.
[14] Liu Y, Bai X, Wang J, et al. Engineering Applications of Artificial Intelligence, 2024, 127: 107260.
[15] XIONG Bin, ZHANG Shuang-de(熊 彬, 张双德). Remote Sensing Information(遥感信息), 2023, 38(4): 73.
[16] Xie W, Lei J, Yang J, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 58(3): 2015.
[17] Jiao C, Chen C, McGarvey R G, et al. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 146: 235.
[18] Greenacre M, Groenen P J F, Hastie T, et al. Nature Reviews Methods Primers, 2023, 3: 22.
[19] LIN Yu-kun, WANG Nan, ZHANG Li-fu, et al(林昱坤, 王 楠, 张立福, 等). National Remote Sensing Bulletin(遥感学报), 2019, 23(6): 1167.
[20] Guo M H, Xu T X, Liu J J, et al. Computational Visual Media, 2022, 8(3): 331.
|
| [1] |
DENG Yun1, 2, WU Wei1, 2, SHI Yuan-yuan3, CHEN Shou-xue1, 2*. Red Soil Organic Matter Content Prediction Model Based on Dilated
Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(10): 2941-2952. |
| [2] |
LIU Yu-juan1, 2, 3, LIU Yan-da1, 2, 3, YAN Zhen1, 4, ZHANG Zhi-yong1, 2, 3, CAO Yi-ming1, 2, 3, SONG Ying1, 2, 3*. Classification of Hybrid Convolution Hyperspectral Images Based on
Attention Mechanism[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(10): 2916-2922. |
| [3] |
SHI Ze-hua1, KANG Zhi-wei1*, LIU Jin2. A Computing Method of Stellar Radial Velocity by Integrating Attention Mechanism[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(09): 2531-2537. |
| [4] |
ZHU Yu-kang1, LU Chang-hua1, ZHANG Yu-jun2, JIANG Wei-wei1*. Quantitative Method to Near-Infrared Spectroscopy With Multi-Feature Fusion Convolutional Neural Network Based on Wavelength Attention[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(09): 2607-2612. |
| [5] |
WANG Shu-tao1, WAN Jin-cong1*, LIU Shi-yu2, ZHANG Jin-qing1, WANG Yu-tian1. Qualitative Modeling Method of Mango Species in Near Infrared Based on Attention Mechanism Residual Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(08): 2262-2267. |
| [6] |
LI Rong1, CAO Guan-long1*, PU Yuan2*, QIU Bo1, WANG Xiao-min1, YAN Jing1, WANG Kun1. TDSC-Net: A Two-Dimensional Stellar Spectra Classification Model Based on Attention Mechanism and Feature Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(07): 1968-1973. |
| [7] |
LI Guo-hou1, LI Ze-xu1, JIN Song-lin1, ZHAO Wen-yi2, PAN Xi-peng3, LIANG Zheng4, QIN Li5, ZHANG Wei-dong1*. Mix Convolutional Neural Networks for Hyperspectral Wheat Variety
Discrimination[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(03): 807-813. |
| [8] |
DENG Yun1, 2, NIU Zhao-wen1, 2, FENG Qi-yao1, 2, WANG Yu1, 2*. A Novel Hyperspectral Prediction Model of Organic Matter in Red Soil Based on Improved Temporal Convolutional Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2942-2951. |
| [9] |
SUN Bang-yong1, YU Meng-ying1, YAO Qi2*. Research on Spectral Reconstruction Method From RGB Imaging Based on Dual Attention Mechanism[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2687-2693. |
| [10] |
WU Kuang, SUN Chun, CAO Guan-long*, QIU Bo*, YAO Lin, ZHANG Ming-ru, ZHANG Li-wen. An Algorithm for Redshift Estimation of Photometric Images Using
Convolutional Neural Networks[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2529-2535. |
| [11] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
| [12] |
XU Xue-bin1, 2, XING Xiao-min1, 2*, AN Mei-juan1, 2, CAO Shu-xin1, 2, MENG Kan1, 2, LU Long-bin1, 2. Palmprint Recognition Method Based on Multispectral Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3615-3625. |
| [13] |
WANG Yang-ping1, 2, HAN Shu-mei1*, YANG Jing-yu1, 2, DANG Jian-wu1, 2, ZHANG Zhan-ping1. Improved YOLOv4 Remote Sensing Image Detection Method of Ground Objects Along Railway[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3275-3282. |
| [14] |
SUN Wen-bin2, WANG Rong1, 3, 4, GAO Rong-hua1, 3*, LI Qi-feng1, 3, WU Hua-rui1, 3, FENG Lu1, 3. Crop Disease Recognition Based on Visible Spectrum and Improved
Attention Module[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1572-1580. |
| [15] |
DAI Ruo-chen1, TANG Huan2*, TANG Bin1*, ZHAO Ming-fu1, DAI Li-yong1, ZHAO Ya3, LONG Zou-rong1, ZHONG Nian-bing1. Study on Detection Method of Foxing on Paper Artifacts Based on
Hyperspectral Imaging Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1567-1571. |
|
|
|
|
