| 光谱学与光谱分析 |
|
|
|
|
|
| Outlier Detection of Time Series Three-Dimensional Fluorescence Spectroscopy |
| YU Shao-hui1, ZHANG Yu-jun2, ZHAO Nan-jing2 |
| 1. School of Mathematics and Statistics, Hefei Normal University, Hefei 230061, China2. Key Laboratory of Environmental Optics & Technology, Anhui Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Hefei 230031, China |
|
|
|
|
Abstract The qualitative and quantitative analysis are often interfered by the outliers in time series three-dimensional fluorescence spectroscopy. In this work, an efficient outlier detection method is proposed by taking advantage of the characteristics in time dimension and the spectral dimension. Firstly, the wavelength points that are mostly the outliers are extracted by the variance in time dimension. Secondly, by the analysis of the existence styles of outliers and similarity score of any two samples, the cumulative similarity is introduced in spectral dimension. At last, fluorescence intensity at each wavelength of all samples is modified by the correction matrix in time dimension and the outlier detection is completed according the to cumulative similarity scores. The application of the correction matrix in time dimension not only improves the validity of the method but also reduces the computation by the choice of characteristics region in correction matrix. Numerical experiments show that the outliers can still be detected by the 50 percent of all points in spectral dimension.
|
|
Received: 2014-03-19
Accepted: 2014-07-02
|
|
|
|
Corresponding Authors:
YU Shao-hui
E-mail: shaohuiy@hftc.edu.cn
|
|
[1] Balkis N. Water Pollution. Croatia: InTech, 2012.
[2] Mortensen P P，Bro R. Chemometrics Intelligent Laboratory System，2006, 84: 106.
[3] Bro R. Chemometrics Intelligent Laboratory System, 1999, (46)：133.
[4] Carstea E M, Baker A, Bieroza M, et al. Water Research, 2010, 44(18): 5356.
[5] Murphy K R, Hambly A, Singh S, et al. Environmental Science & Technology, 2011, 45(7): 2909.
[6] Hur J, Cho J. Sensors, 2012, 12: 972.
[7] Oto N N, Oshita S S, Makino Y Y, et al. Meat Science, 2013, 93(3): 579.
[8] Sanchez N P, Skeriotis A T, Miller C M. Water Research, 2013, 47(4): 1679.
[9] Sanchez N P, Skeriotis A T, Miller C M. Environmental Science & Technology, 2014, 48(3): 1582.
[10] Lee J S, Cox D D. Computational Statistics & Data Analysis, 2010, 54(12): 3131.
[11] Sanchez N P, Skeriotis A T, Miller C M. Water Research, 2013, 47(4): 1679.
[12] Lawaetz A J, Bro R, Nielsen M K, et al. Metabolomics, 2012, 8(1): 111.
[13] Bro R, Vidal M. Chemometrics and Intelligent Laboratory Systems, 2011, 106(1): 86.
[14] Su W X, Zhu Y L, Liu F, et al. Journal of Central South University, 2013, 20(1): 114.
[15] Gupta M, Gao J, Aggarwal C C, et al. IEEE Transactions on Knowledge and Data Engineering, 2013, 26(9): 2250. |
| [1] |
TAN Ai-ling1, WANG Si-yuan1, ZHAO Yong2, ZHOU Kun-peng1, LU Zhang-jian1. Research on Vinegar Brand Traceability Based on Three-Dimensional Fluorescence Spectra and Quaternion Principal Component Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(07): 2163-2169. |
| [2] |
OUYANG Heng1,2*, XIAO Jian-ren3, LIN Xiu-yong4, FAN Gong-duan4*. Compositional Characteristics of Dissolved Organic Matter in Water Treatment Systems of Water Source Heat Pump Based on Three-Dimensional Fluorescence Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(04): 1146-1152. |
| [3] |
WANG Yu-tian, LIU Ting-ting*, LIU Ling-fei, YANG Zhe, CUI Yao-yao. Determination of Polycyclic Aromatic Hydrocarbons in Water Based on Three Dimensional Fluorescence Spectroscopy Combined with Wavelet Compression and APTLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(04): 1171-1177. |
| [4] |
ZHOU Yan-lei1, ZHOU Fei-fei1, JIANG Cong-cong1, SHI Xiao-yong1，2*, SU Rong-guo1. Research of Identification Method for the Oil Spills Species Based on Fluorescence Excitation-Emission Matrix and Parallel Factor Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(02): 475-480. |
| [5] |
SUN Gui-fen1, QIN Xian-lin1*, YIN Ling-yu1, LIU Shu-chao1, LI Zeng-yuan1, CHEN Xiao-zhong2, ZHONG Xiang-qing2. Changes Analysis of Post-Fire Vegetation Spectrum and Index Based on Time Series GF-1 WFV Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(02): 511-517. |
| [6] |
XIE Zhi-yong1,2, XIE Li-qin1,2, JIANG Shen-hua1,2,3*, QU Wen-juan1,3, ZHANG Xiao-xia1,2, ZHANG Hua-hao1,2, HAO Shu1,2, ZHANG Liang-hui1,2, MA Hai-le1,3, SHEN Yong-gen1,4. The Comparison of Inhibition on LDL Non-Enzymatic Glycosylation and Oxidation between Ethyl Acetate Extracts of Clove and Clove Bud Oil Based on Spectroscopy Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(02): 518-527. |
| [7] |
WANG Bi1, 2, XI Hong-bo2, ZHOU Yue-xi1, 2*, CHEN Xue-min1, FU Xiao-yong1. Effects of Different Substituents on Three Dimensional Fluorescence Properties of BTEX[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(12): 3763-3770. |
| [8] |
WANG Yu-tian1, ZHANG Li-juan1, 2*, ZHAO Xu1, CHEN Yi-qiang3, PAN Zhao1, CAO Li-fang1, XU Jing1, YUAN Yuan-yuan1, NIU Kai-zeng1, ZHANG Ya-ji1. Study on the Three-Dimensional Fluorescence Spectra of Oil Mixture and Its Composition Based on Tri-PLS Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(12): 3771-3775. |
| [9] |
HUANG Zhen-rong1, CHENG Cheng2, TANG Jiu-kai2, Lü Wei-ming1, TAO Ting-ting1, WANG Xiao-jiong1, WU Jing2*. Characterization of Organic Matters in the Effluent of Dyeing and Printing Wastewater Treatment Plants with Fluorescence Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(10): 3118-3121. |
| [10] |
LI Shuai-dong1, 2, 3, JIANG Quan-liang3, LI Ye3, WU Ya-lin3, JIANG Jun-wu3, HUANG Tao1, 2, 3, YANG Hao3, HUANG Chang-chun1, 2, 3*. Spectroscopic Characteristics and Sources of Dissolved Organic Matter from Soils around Dianchi Lake, Kunming[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(05): 1448-1454. |
| [11] |
YU Shao-hui1, XIAO Xue2, XU Ge1. Data Compression of Time Series Three-Dimensional Fluorescence Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(04): 1163-1167. |
| [12] |
LI Shuai-dong1, 2, 3, ZHANG Ming-li3, YANG Hao3, LIU Da-qing3, YU Li-yan3, HUANG Tao1, 2, 3*, HUANG Chang-chun1, 2, 3*. Spectroscopic Characteristics of Dissolved Organic Matter from Top Soils on SongHuaba Reservoir in Kunmimg[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(04): 1183-1188. |
| [13] |
LI Lei1, 2, LI Zhong-pei1, 2*, LIU Ming1, 2, MA Xiao-yan1, 2, TANG Xiao-xue1, 2 . Characterizing Dissolved Organic Matter (DOM) in Wastewater from Scale Pig Farms Using Three-Dimensional Excitation-Emission Matrices (3DEEM) [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(02): 577-583. |
| [14] |
JIANG Chun-lei1，2, ZHANG Shu-qing1*, ZHANG Ce3, LI Hua-peng1, DING Xiao-hui1，2 . Modeling and Predicting of MODIS Leaf Area Index Time Series Based on a Hybrid SARIMA and BP Neural Network Method [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(01): 189-193. |
| [15] |
ZHANG Li-guo1,3, CHEN Zhi-kun1, 2, WANG Li1*, CAO Li-fang1, YAN Bing1, WANG Yu-tian1 . Study on Refined Oil Identification and Measurement Based on the Extension Neural Network Pattern Recognition[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(09): 2901-2905. |
|
|
|
|
