|
|
|
|
|
|
Identification of Two-Dimensional Material Nanosheets Based on Deep Neural Network and Hyperspectral Microscopy Images |
PENG Ren-miao1, 2, XU Peng-peng2, ZHAO Yi-mo2, BAO Li-jun1, LI Cheng2* |
1. School of Electronic Science and Engineering,Xiamen University, Xiamen 361005, China
2. College of Physical Science and Technology, Xiamen University, Xiamen 361005, China
|
|
|
Abstract In recent years, two-dimensional materials have received widespread attention due to their unique properties. Among the various methods for preparing two-dimensional layered crystals, the thin-layer two-dimensional material crystals obtained by mechanical exfoliation are of high quality, suitable for basic research and performance demonstration. However, mechanically exfoliated crystals on substrates exhibit a certain degree of randomness, including a few layers and relatively thick flakes. The effective, rapid and intelligent characterization method of these two-dimensional nanostructures is beneficial to further research on the properties of two-dimensional materials. This paper proposes a method based on deep learning, which can segment and quickly identify two-dimensional material nanosheets based on optical microscope images through a convolutional neural network semantic segmentation algorithm built with an encoding-decoding structure. As a typical algorithm for deep learning in the field of image processing, Convolutional neural networks can be applied to the feature extraction in optical microscope images. Firstly, MoS2 nanosheet samples were prepared by mechanical exfoliation, and high spectroscopic images were acquired by optical microscopy. The nanosheet samples were labeled, and the marked images were further processed, including color calibration and sliding shear operation, to obtain datasets for network training and testing. A semantic segmentation algorithm based on encoding-decoding network structure was designed to rapidly identify nanosheets. Aiming at some flakes in images showing the characteristic of low contrast and fragmentation, residual convolution and pyramid pooling models were added to strengthen the extraction of features during encoding. The shallow feature information extracted from the encoding stage was reused during decoding to improve the network segmentation results. In the experiment, the weighted cross-entropy loss function was used to solve the problem of unbalanced classes, and the dataset was enlarged with data augmentation. Testing on the trained network show that the pixel accuracy was 97.38%, the mean pixel accuracy was 90.38%, and the mean intersection over union was 75.86%. Then, the exfoliated monolayer and bilayer graphenes were identified by transfer learning, and the mean intersection over union reached 81.63%, showing that this technique is universal for the identification of two-dimensional nanosheets. The identification of MoS2 and graphene nanosheets realizes the application of deep learning in optical microscopy images of two-dimensional materials. This method is expected to apply to more two-dimensional materials and break through the problem of automatic dynamic processing of optical images. Moreover, it provides a reference for hyperspectral images processing of other nanomaterials.
|
Received: 2021-05-23
Accepted: 2021-08-13
|
|
Corresponding Authors:
LI Cheng
E-mail: lich@xmu.edu.cn
|
|
[1] Novoselov K S, Geim A K, Morozov S V, et al. Science, 2004, 306(5296): 666.
[2] Wang Q H, Kalantar-Zadeh K, Kis A, et al. Nature Nanotechnology, 2012, 7(11): 699.
[3] Buscema M, Groenendijk D J, Blanter S I, et al. Nano Letters, 2014, 14(6): 3347.
[4] Zhang K, Feng Y, Wang F, et al. Journal of Materials Chemistry C, 2017, 5(46): 11992.
[5] Li H, Wu J, Huang X, et al. ACS Nano, 2013, 7(11): 10344.
[6] WANG Can, WU Xin-hui, LI Lian-qing, et al(王 璨, 武新慧, 李恋卿, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2018, 38(1): 36.
[7] Krizhevsky A, Sutskever I, Hinton G E, et al. Communications of the ACM, 2017, 60(6): 84.
[8] Long J, Shelhamer E, Darrell T. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2015, 39(4): 640.
[9] Ronneberger O, Fischer P, Brox T. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, 9351: 234.
[10] Badrinarayanan V, Kendall A, Cipolla R. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, 39(12): 2481.
[11] Grvik E, Yi D, Iv M, et al. Journal of Magnetic Resonance Imaging, 2020, 51(1): 175.
[12] Wang C, Zhao Z, Ren Q, et al. Entropy, 2019, 21(2): 168.
[13] He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
[14] Zhao H S, Shi J P, Qi X J, et al. Pyramid Scene Parsing Network, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[15] Lateef F, Ruichek Y. Neurocomputing, 2019, 338: 321.
|
[1] |
JI Jiang-tao1, 2, LI Peng-ge1, JIN Xin1, 2*, MA Hao1, 2, LI Ming-yong1. Study on Quantitative Detection of Tomato Seedling Robustness
in Spring Seedling Transplanting Period Based on VIS-NIR
Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1741-1748. |
[2] |
JIANG Rong-chang1, 2, GU Ming-sheng2, ZHAO Qing-he1, LI Xin-ran1, SHEN Jing-xin1, 3, SU Zhong-bin1*. Identification of Pesticide Residue Types in Chinese Cabbage Based on Hyperspectral and Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1385-1392. |
[3] |
JI Rong-hua1, 2, ZHAO Ying-ying2, LI Min-zan2, ZHENG Li-hua2*. Research on Prediction Model of Soil Nitrogen Content Based on
Encoder-CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1372-1377. |
[4] |
ZHAO Yong1, HE Men-yuan1, WANG Bo-lin2, ZHAO Rong2, MENG Zong1*. Classification of Mycoplasma Pneumoniae Strains Based on
One-Dimensional Convolutional Neural Network and
Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1439-1444. |
[5] |
WENG Shi-zhuang*, CHU Zhao-jie, WANG Man-qin, WANG Nian. Reflectance Spectroscopy for Accurate and Fast Analysis of Saturated
Fatty Acid of Edible Oil Using Spectroscopy-Based 2D Convolution
Regression Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1490-1496. |
[6] |
TAN Ai-ling1, CHU Zhen-yuan1, WANG Xiao-si1, ZHAO Yong2*. Detection of Pearl Powder Adulteration Based on Raman Spectroscopy and DCGAN Data Enhancement[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(03): 769-775. |
[7] |
DENG Shi-yu1, 2, LIU Cheng-zhi1, 4*, TAN Yong3*, LIU De-long1, ZHANG Nan1, KANG Zhe1, LI Zhen-wei1, FAN Cun-bo1, 4, JIANG Chun-xu3, LÜ Zhong3. A Combination of Multiple Deep Learning Methods Applied to Small-Sample Space Objects Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 609-615. |
[8] |
JIAO Qing-liang1, LIU Ming1*, YU Kun2, LIU Zi-long2, 3, KONG Ling-qin1, HUI Mei1, DONG Li-quan1, ZHAO Yue-jin1. Spectral Pre-Processing Based on Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(01): 292-297. |
[9] |
YU Guo-wei1, MA Ben-xue1,2*, CHEN Jin-cheng1,3, DANG Fu-min4,5, LI Xiao-zhan1, LI Cong1, WANG Gang1. Vis-NIR Spectra Discriminant of Pesticide Residues on the Hami Melon Surface by GADF and Multi-Scale CNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3701-3707. |
[10] |
DUAN Long1, YAN Tian-ying1, WANG Jiang-li2, 3, YE Wei-xin1, CHEN Wei1, GAO Pan1, 2*, LÜ Xin2, 3*. Combine Hyperspectral Imaging and Machine Learning to Identify the Age of Cotton Seeds[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(12): 3857-3863. |
[11] |
CHEN Qi1,3, PAN Tian-hong2,4*, LI Yu-qiang4, LIN Hong4. Geographical Origin Discrimination of Taiping Houkui Tea Using Convolutional Neural Network and Near-Infrared Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(09): 2776-2781. |
[12] |
GUI Jiang-sheng1, FEI Jing-yi1, FU Xia-ping2. Hyperspectral Imaging for Detection of Leguminivora Glycinivorella Based on 3D Few-Shot Meta-Learning Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2171-2174. |
[13] |
WANG Cheng-kun1, ZHAO Peng1,2*. Study on Simultaneous Classification of Hardwood and Softwood Species Based on Spectral and Image Characteristics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1713-1721. |
[14] |
LI Qing-xu1, WANG Qiao-hua1, 2*, MA Mei-hu3, XIAO Shi-jie1, SHI Hang1. Non-Destructive Detection of Male and Female Information of Early Duck Embryos Based on Visible/Near Infrared Spectroscopy and Deep Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1800-1805. |
[15] |
HAO Hui-min1,2, LIANG Yong-guo1,2, WU Hai-bin1,2, BU Ming-long1,2, HUANG Jia-hai1,2*. Infrared Spectrum Recognition Method Based on Symmetrized Dot Patterns Coupled With Deep Convolutional Neural Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(03): 782-788. |
|
|
|
|