|
|
|
|
|
|
Identification of Two-Dimensional Material Nanosheets Based on Deep Neural Network and Hyperspectral Microscopy Images |
PENG Ren-miao1, 2, XU Peng-peng2, ZHAO Yi-mo2, BAO Li-jun1, LI Cheng2* |
1. School of Electronic Science and Engineering,Xiamen University, Xiamen 361005, China
2. College of Physical Science and Technology, Xiamen University, Xiamen 361005, China
|
|
|
Abstract In recent years, two-dimensional materials have received widespread attention due to their unique properties. Among the various methods for preparing two-dimensional layered crystals, the thin-layer two-dimensional material crystals obtained by mechanical exfoliation are of high quality, suitable for basic research and performance demonstration. However, mechanically exfoliated crystals on substrates exhibit a certain degree of randomness, including a few layers and relatively thick flakes. The effective, rapid and intelligent characterization method of these two-dimensional nanostructures is beneficial to further research on the properties of two-dimensional materials. This paper proposes a method based on deep learning, which can segment and quickly identify two-dimensional material nanosheets based on optical microscope images through a convolutional neural network semantic segmentation algorithm built with an encoding-decoding structure. As a typical algorithm for deep learning in the field of image processing, Convolutional neural networks can be applied to the feature extraction in optical microscope images. Firstly, MoS2 nanosheet samples were prepared by mechanical exfoliation, and high spectroscopic images were acquired by optical microscopy. The nanosheet samples were labeled, and the marked images were further processed, including color calibration and sliding shear operation, to obtain datasets for network training and testing. A semantic segmentation algorithm based on encoding-decoding network structure was designed to rapidly identify nanosheets. Aiming at some flakes in images showing the characteristic of low contrast and fragmentation, residual convolution and pyramid pooling models were added to strengthen the extraction of features during encoding. The shallow feature information extracted from the encoding stage was reused during decoding to improve the network segmentation results. In the experiment, the weighted cross-entropy loss function was used to solve the problem of unbalanced classes, and the dataset was enlarged with data augmentation. Testing on the trained network show that the pixel accuracy was 97.38%, the mean pixel accuracy was 90.38%, and the mean intersection over union was 75.86%. Then, the exfoliated monolayer and bilayer graphenes were identified by transfer learning, and the mean intersection over union reached 81.63%, showing that this technique is universal for the identification of two-dimensional nanosheets. The identification of MoS2 and graphene nanosheets realizes the application of deep learning in optical microscopy images of two-dimensional materials. This method is expected to apply to more two-dimensional materials and break through the problem of automatic dynamic processing of optical images. Moreover, it provides a reference for hyperspectral images processing of other nanomaterials.
|
Received: 2021-05-23
Accepted: 2021-08-13
|
|
Corresponding Authors:
LI Cheng
E-mail: lich@xmu.edu.cn
|
|
[1] Novoselov K S, Geim A K, Morozov S V, et al. Science, 2004, 306(5296): 666.
[2] Wang Q H, Kalantar-Zadeh K, Kis A, et al. Nature Nanotechnology, 2012, 7(11): 699.
[3] Buscema M, Groenendijk D J, Blanter S I, et al. Nano Letters, 2014, 14(6): 3347.
[4] Zhang K, Feng Y, Wang F, et al. Journal of Materials Chemistry C, 2017, 5(46): 11992.
[5] Li H, Wu J, Huang X, et al. ACS Nano, 2013, 7(11): 10344.
[6] WANG Can, WU Xin-hui, LI Lian-qing, et al(王 璨, 武新慧, 李恋卿, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2018, 38(1): 36.
[7] Krizhevsky A, Sutskever I, Hinton G E, et al. Communications of the ACM, 2017, 60(6): 84.
[8] Long J, Shelhamer E, Darrell T. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2015, 39(4): 640.
[9] Ronneberger O, Fischer P, Brox T. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, 9351: 234.
[10] Badrinarayanan V, Kendall A, Cipolla R. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, 39(12): 2481.
[11] Grvik E, Yi D, Iv M, et al. Journal of Magnetic Resonance Imaging, 2020, 51(1): 175.
[12] Wang C, Zhao Z, Ren Q, et al. Entropy, 2019, 21(2): 168.
[13] He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
[14] Zhao H S, Shi J P, Qi X J, et al. Pyramid Scene Parsing Network, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[15] Lateef F, Ruichek Y. Neurocomputing, 2019, 338: 321.
|
[1] |
LI Xin-ting, ZHANG Feng, FENG Jie*. Convolutional Neural Network Combined With Improved Spectral
Processing Method for Potato Disease Detection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 215-224. |
[2] |
LAN Yan1,WANG Wu1,XU Wen2,CHAI Qin-qin1*,LI Yu-rong1,ZHANG Xun2. Discrimination of Planting and Tissue-Cultured Anoectochilus Roxburghii Based on SMOTE and Inception-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 158-163. |
[3] |
ZHU Wen-jing1, 2,FENG Zhan-kang1, 2,DAI Shi-yuan1, 2,ZHANG Ping-ping3,JI Wen4,WANG Ai-chen1, 2,WEI Xin-hua1, 2*. Multi-Feature Fusion Detection of Wheat Lodging Information Based on UAV Multispectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 197-206. |
[4] |
WANG Qi-biao1, HE Yu-kai1, LUO Yu-shi1, WANG Shu-jun1, XIE Bo2, DENG Chao2*, LIU Yong3, TUO Xian-guo3. Study on Analysis Method of Distiller's Grains Acidity Based on
Convolutional Neural Network and Near Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3726-3731. |
[5] |
HUANG Meng-qiang1, KUANG Wen-jian2, 3*, LIU Xiang1, HE Liang4. Quantitative Analysis of Cotton/Polyester/Wool Blended Fiber Content by Near-Infrared Spectroscopy Based on 1D-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3565-3570. |
[6] |
YANG Sen1, ZHANG Xin-ao1, XING Jian1, DAI Jing-min2. Study on Multi-Feature Model Fusion Variety Classification and Multi-Parameter Appearance Inspection for Milled Rice[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2837-2842. |
[7] |
CAI Jian-rong1, 2, HUANG Chu-jun1, MA Li-xin1, ZHAI Li-xiang1, GUO Zhi-ming1, 3*. Hand-Held Visible/Near Infrared Nondestructive Detection System for Soluble Solid Content in Mandarin by 1D-CNN Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2792-2798. |
[8] |
YE Wen-chao1, LUO Shui-yang1, LI Jin-hao1, LI Zhao-rong1, FAN Zhi-wen1, XU Hai-tao1, ZHAO Jing1, LAN Yu-bin1, 2, DENG Hai-dong1*, LONG Yong-bing1, 2, 3*. Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2935-2941. |
[9] |
PU Shan-shan, ZHENG En-rang*, CHEN Bei. Research on A Classification Algorithm of Near-Infrared Spectroscopy Based on 1D-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2446-2451. |
[10] |
ZHANG Zhi-fen1, LIU Zi-min1, QIN Rui1, LI Geng1, WEN Guang-rui1, HE Wei-feng2. Real-Time Detection of Protective Coating Damage During Laser Shock Peening Based on ReliefF Feature Weight Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2437-2445. |
[11] |
YANG Dong-feng1, HU Jun2*. Accurate Identification of Maize Varieties Based on Feature Fusion of Near Infrared Spectrum and Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2588-2595. |
[12] |
TANG Ting, PAN Xin*, LUO Xiao-ling, GAO Xiao-jing. Fusion of ConvLSTM and Multi-Attention Mechanism Network for
Hyperspectral Image Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2608-2616. |
[13] |
LI Wen-xia1, DU Yu-jun2, WANG Yue1, LIU Zheng-dong3*, ZHENG Jia-hui1, DU Wen-qian1, WANG Hua-ping4. Research on On-Line Efficient Near-Infrared Spectral Recognition and Automatic Sorting Technology of Waste Textiles Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2139-2145. |
[14] |
LIANG Wan-jie1, FENG Hui2, JIANG Dong3, ZHANG Wen-yu1, 4, CAO Jing1, CAO Hong-xin1*. Early Recognition of Sclerotinia Stem Rot on Oilseed Rape by Hyperspectral Imaging Combined With Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2220-2225. |
[15] |
JIANG Xia*, QIU Bo, WANG Lin-qian, GUO Xiao-yu. Automatic Classification Method of Star Spectra Based on
Semi-Supervised Mode[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1875-1880. |
|
|
|
|