基于机器学习的水体化学需氧量高光谱反演模型对比研究

doi:10.3964/j.issn.1000-0593(2022)08-2353-06

Abstract
References
Related Citation (15)

Download: PDF (3565 KB)
Export: BibTeX | EndNote (RIS)

Abstract Chemical oxygen demand (COD) is an important indicator of organic pollution in water. How to quickly and accurately test the COD content of water is particularly important. The application of machine learning in the field of water quality inversion is increasing, and more research results have been obtained. Hyperspectral remote sensing has the advantages of high spectral-spatial resolution and multiple imaging channels, so it has great potential in retrieving water’s COD. This study uses different hyperspectral pre-processing methods to process the original hyperspectral data. It uses the hyperspectral data before and after processing to compare the inversion performance of different machine learning models and different hyperspectral pre-processing methods on the COD content of water. Firstly, 1 548 groups of COD content and corresponding hyperspectral data (400~1 000 nm) samples were collected by ZK-UVIR-I in-situ spectral water quality on-line monitor in Baodai River. In order to reduce the interference of spectral noise and eliminate the influence of spectral scattering, Savitzky-Golay (SG) smoothing, Multiplicative scatter correction (MSC) and SG smoothing combined with MSC methods were used to pre-process the original spectra. Secondly, the sample set is randomly divided into training set and test set, where the training set accounts for 80% and the test set accounts for 20%. A COD hyperspectral inversion model based on the four machine learning methods of linear regression, random forest (random forest), AdaBoost, and XGBoost was established for the pre-processed training set full-band spectrum. Moreover, three indexes of determination coefficient (R²), root mean square error (RMSE) and relative analysis error (RPD) were selected to evaluate the accuracy of the hyperspectral inversion model. The results show that random forest, AdaBoost and XGboost are all the better than linear regression. The prediction ability of the inversion model established by XGboost is the best whether the spectral data is processed or not, with R² of 0.92, RMSE of 7.1 mg·L^-1, and RPD of 3.4. Considering that the original spectrum may be redundant, the dimensionality reduction of the spectrum after SG smoothing and MSC processing is performed by principal component analysis (PCA), and the top ten principal components with a cumulative contribution rate of 95% are selected as the input variables of the model. XGBoost established the inversion model, and the results show that after PCA, the accuracy of the inversion model is improved, the RPD is 3.8, and the training time of the model is shortened from 72 seconds to 2.9 seconds. The above research can provide new methods and ideas for establishing hyperspectral inversion models of this water area and similar water areas.

Key words：Chemical oxgen demand（COD）;Machine learning;Hyperspectral;Iversion model comparison

Received: 2021-06-15 Accepted: 2021-11-02

ZTFLH:

O433.4

Corresponding Authors: MING Xing E-mail: mingnix@163.com

Cite this article:

WANG Chun-ling,SHI Kai-yuan,MING Xing, et al. A Comparative Study of the COD Hyperspectral Inversion Models in Water Based on the Maching Learning[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(08): 2353-2358.

URL:

http://www.gpxygpfx.com/EN/10.3964/j.issn.1000-0593(2022)08-2353-06 OR http://www.gpxygpfx.com/EN/Y2022/V42/I08/2353