光谱学与光谱分析 |
|
|
|
|
|
Research on the Noise Reduction with Hyper-Resolution Infrared Spectrum Based on Improved PCV Method |
HUANG Wei, GAO Tai-chang*, LIU Lei, LI Shu-lei |
College of Meteorology and Oceanography, the PLA University of Science and Technology, Nanjing 211101, China |
|
|
Abstract The noise reduction with observed high resolution infrared radiance is crucial to improve the accuracy and stability of the retrieval of thermodynamic profiles. When applying the principal component analysis noise filter algorithm to the observed radiance, the optimal number k of principal components that used in the algorithm was mostly calculated with the statistical and empirical method. The percent cumulative variance method is one of the statistical methods that have been commonly used to calculate k, however, the threshold of the percent cumulative variance was determined subjectively and arbitrarily, which limits the application of this method. While the empirical method need the real-time Noise-Equivalent Spectral Radiance (NESR) to normalize non uniform noise in the observed data, but the real-time NESR needs the raw data of complex spectrum which is not easy to obtain in most cases. Aiming at the solving the problems above, a PCA noise filter based on the Improved PCV algorithm is proposed, of which the threshold is determined by iteratively calculating the difference between the simulated and reconstructed spectrum using different principal components, whereby k is determined such that the PCV is larger than the threshold. The new method solves the problem of arbitrary of the determination of k, and at the same time it doesn’t need the real-time NESR to normalize the observed radiance. First, the impact of normalization on the noise reduction is analyzed using physical retrieval of temperature profiles; the result shows that the impact is very small, which less than the impact of calculation error of k is caused by normalization on the retrieval of temperature profiles. Then, the noise reduction of the representative radiance data which covers four quarters of 2011 shows that, the RMSE of the retrieved temperature profile using the Improved PCV method is improved by 0.1 K compared to the factor indicator function method when the real-time NESR is not available, and it is almost the same with the latter when the normalization is done. Under the condition that the NESR is not available, the method proposed in this article could objectively and reasonably reduce the noise level of the ground-based high resolution infrared radiance.
|
Received: 2016-02-10
Accepted: 2016-05-12
|
|
Corresponding Authors:
GAO Tai-chang
E-mail: 2009gaotc@gmail.com
|
|
[1] Turner D D, Feltz W F, Ferrare R A. Bulletin of the American Meteorological Society,2000,81(6): 1301. [2] Smith W L, Feltz W F, Knuteson R O, et al. Journal of Atmospheric and Oceanic Technology,1999,16(2-3): 323. [3] Kang S, Goo T, Ou M. Journal of Atmospheric and Oceanic Technology,2013,30(7): 1433. [4] Rodgers C D. Inverse Methods for Atmospheric Sounding: Theory and Practice. Singapore: World Scientific, 2000. [5] Antonelli P. Journal of Geophysical Research,2004,109(D23):102(DOI:10.1029/2004JD004862). [6] Huang H, Antonelli P. Journal of Applied Meteorology,2001,40(3): 365. [7] Turner D D, Knuteson R O, Revercomb H E, et al. Journal of Atmospheric and Oceanic Technology,2006,(9): 1223. [8] Aires F, Rossow W B, Scott N A, et al. Journal of Geophysical Research,2002, 107(D22): 4619, DOI: 10.1029/2001JD000955. [9] Knuteson R O, Revercomb H E, Best F A, et al. Journal of Atmospheric and Oceanic Technology,2004,(12): 1777. [10] CHEN Xiu-hong, WEI He-li(陈秀红,魏合理). Journal of Atmospheric and Environmental Optics(大气与环境光学学报), 2007, 2(2): 99. [11] LI Jun, ZENG Qing-cun(李 俊,曾庆存). Chinese Journal of Atmospheric Sciences(大气科学),1997,21(2): 214. [12] Turner D D, Lhnert U. Journal of Applied Meteorology and Climatology,2014,(3): 752. |
[1] |
LI Ming-liang1, DAI Yu-jia1, QIN Shuang1, SONG Chao2*, GAO Xun1*, LIN Jing-quan1. Influence of LIBS Analysis Model on Quantitative Analysis Precision of Aluminum Alloy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(02): 587-591. |
[2] |
LI Shuo1, LI Chun-lian1, CHEN Song-chao3, 4, XU Dong-yun2, SHI Zhou2*. Removing the Effects of Water From Visible-Near Infrared Spectra in Soil Profiles for the Estimation of Organic Carbon[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(04): 1234-1239. |
[3] |
ZHOU Si-han1,2, HU Xin-yu1,2, TANG Bin1,2,3*, ZHAO Ming-fu1,2, LI Feng-xiao1,2, WANG Ren-jie1,2, XIAO Qi-sen1,2, XIAO Yu1,2. Application Research of Normalization Algorithm Based on EWMA-PCA in Standardization of Water Quality Spectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(11): 3443-3450. |
[4] |
ZHOU Mo1, 2, ZOU Bin1, 2*, TU Yu-long1, 2, XIA Ji-pin1, 2. Hyperspectral Modeling of Pb Content in Mining Area Based on Spectral Feature Band Extracted from Near Standard Soil Samples[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(07): 2182-2187. |
[5] |
ZHONG Qi-xiu1, 2, 3, ZHAO Tian-zhuo1, 2, 3*, LI Xin1, 2, 3, LIAN Fu-qiang1, 3, XIAO Hong1, 3, NIE Shu-zhen1, 3, SUN Si-ning3, 4, FAN Zhong-wei1, 2, 3. Standardized Cross-Validation and Its Optimization for Multi-Element LIBS Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(02): 622-627. |
[6] |
JIANG Xiao-lu1, ZOU Bin1, 2*, TU Yu-long1, FENG Hui-hui1, CHEN Xu1. Quantitative Estimation of Cd Concentrations of Type Standard Soil Samples Using Hyperspectral Data[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(10): 3254-3260. |
[7] |
ZHU Hua-dong1, 2, ZHOU Li1, 2, CHANG Hong-gang1, 2, SUN Xiao-yan1,2. Study on Standardization of Natural Gas Composition Analysis by Laser Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(10): 3286-3294. |
[8] |
LIU Cui-ling, LI Tian-rui*, WEI Li-na, XU Ying-ying, WU Jing-zhu. Research on Application of Direct Standardization Algorithm in Near-Infrared Spectrum Calibration Transfer of Acid Value and Peroxide Value of Edible Oil[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(10): 3042-3050. |
[9] |
LIANG Chen1, ZHAO Zhong1*, CAO Yu-ting1, YUAN Hong-fu2. A New Study of Calibration Model Transfer Method for Near-Infrared Spectral Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(05): 1587-1594. |
[10] |
CHEN Yi-yun1, 2, QI Kun1, 4, LIU Yao-lin1, 2, HE Jian-hua1, 2, JIANG Qing-hu3* . Transferability of Hyperspectral Model for Estimating Soil Organic Matter Concerned with Soil Moisture[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(06): 1705-1708. |
[11] |
LI Meng1,2, HE Ming-xia1,2*, TIAN Zhen1 . Studies on Signal-to-Noise Ratio Standardization for THz Time-Domain Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(03): 606-609. |
[12] |
WEI Xiang-qin1, 2, GU Xing-fa1, 2*, YU Tao1, 2, MENG Qing-yan1, 2*, LI Bin1, 2, GUO Hong1, 2, . Spatial Resolution Standardization of Payload on Board of Remote Sensing Satellite Based on Application Requirements [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(03): 781-785. |
[13] |
LI Xiang-ru. Efficient Computation of Spectral Flux Normalization [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(01): 179-182. |
[14] |
HUANG Cheng-wei,DAI Lian-kui*,DONG Xue-feng . The Application of Piecewise Direct Standardization with SNV in Calibration Transfer of Raman Spectra [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(05): 1279-1282. |
[15] |
SUN Qin-ping1,JIA Liang-liang2,RUI Yu-kui1,CHEN Xin-ping1*,ZHANG Fu-suo1 . Nitrogen Status Diagnosis of Summer Maize by Using Visible Spectral Analysis Technology[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2009, 29(02): 432-435. |
|
|
|
|