SONG Ruo-xi1, 3, FENG Yi-ning3, CHENG Wei2, WANG Xiang-hai2, 3*
1. Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China
2. School of Computer and Information Technology, Liaoning Normal University, Dalian 116081, China
3. School of Geography, Liaoning Normal University, Dalian 116029, China
Abstract：With the rapid development of modern remote sensing techniques, remote sensing image change detection has become one of the most important means of the land-cover monitoring process. It has been widely used in application areas such as Geographic Situation Detection, Land Survey, Ecosystem Monitoring, Disaster Monitoring and Assessment, Food Security Insurance and military reconnaissance. The fine spectral resolution of the hyperspectral (HS) image and the detailed spectral change information of the multitemporal HS images brings the possibility for detecting the subtle changes associated with the dynamic land-cover transition. However, the high complexity data structure, high dimensional data features, and high redundancy information of the HS images makes HS change detection extremely challenging. This paper reviews the research advance of multitemporal HS image change detection, including: (1) Traditional HS image change detection approach based on the generalized similarity measurement of the HS images, which mainly follows the modeling process of multispectral change detection methods; (2) Dimensionality reduction based HS image change detection approaches, which are designed to overcome the adverse effects of the high dimensionality, high redundancy properties of the HS images; (3) Statistical modeling based HS image change detection approaches, which determines the change detection results by modeling of the statistical properties and multi-dimensional correlations of the HS images; (4) Classification based HS image change detection approaches, which introduces the image classification strategy into the change detection process to provide guarantee for obtaining the “from-to” type change information; (5) Unmixing based HS image change detection approaches, which are mainly developed to solve the mixed pixel phenomenon caused by the low spatial resolution of HS images; (6) Deep learning based HS image change detection approaches, which applied the deep learning methods into the HS image change detection tasks. Finally, the three major challenges and future development of HS image change detection are prospected.
[1] Song C, Huang B, Ke L, et al. ISPRS Journal of Photogrammetry and Remote Sensing, 2014, 92(6): 26.
[2] Liu Y, Pang C, Zhan Z, et al. IEEE Geoscience and Remote Sensing Letters, 2021, 18(5): 811.
[3] Ghaderpour E, Vujadinovic T. Remote Sensing, 2020, 12(23): 4001.
[4] Olaniyi S S, Igbokwe J I, Ojiako J C. International Journal of Scientific Research in Science and Technology, 2020, 7(2): 44(doi: 10.32628/IJSRST207154).
[5] YU Xu-chu, FENG Wu-fa, YANG Guo-peng, et al(余旭初, 冯伍法, 杨国鹏, 等). Analysis and Applications of Hyperspectral Imaging(高光谱影像分析和应用). Beijing: China Science Publishing & Media Ltd., Science Press（北京: 中国科技出版传媒有限公司科学出版社）, 2013.
[6] Ghamisi P, Yokoya N, Li J, et al. IEEE Geoscience & Remote Sensing Magazine, 2018, 5(4): 37.
[7] ZHANG Liang-pei, WU Chen(张良培, 武 辰). Acta Geodaetica et Cartographica(测绘学报), 2017, 46(10): 1447.
[8] Liu S, Marinelli D, Bruzzone L, et al. IEEE Geoscience and Remote Sensing Magazine, 2019, 7(2): 140.
[9] Hasanlou M, Seydi S T. International Journal of Remote Sensing, 2018, 39(20): 7029.
[10] Wang C, Liu B, Liu L, et al. Artificial Intelligence Review, 2021, 54(7): 5205.
[11] Sun W, Du Q. IEEE Geoscience and Remote Sensing Magazine, 2019, 7(2): 118.
[12] Li S, Song W, Fang Y, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(9): 6690.
[13] Uto K, Seki H, Saito G, et al. Development of Lightweight Hyperspectral Imaging System for UAV Observation, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), 2014, 1.
[14] Zhong Y, Wang X, Wang S, et al. Geo-Spatial Information Science, 2021, 24(1): 95.
[15] TONG Qing-xi, ZHANG Bing, ZHANG Li-fu(童庆禧, 张 兵, 张立福). National Remote Sensing Bulletin(遥感学报), 2016, 20(5): 689.
[16] Wu B, Guo J, Zhang Y, et al. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(12): 4889.
[17] Ren H, Ye X, Liu R, et al. IEEE Transactionson Geoscienceand Remote Sensing, 2017, 52(2): 1080.
[18] Shi H, Li Z, Ye H, et al. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(2): 899.
[19] Tu B, Yang X, Li N, et al. Pattern Recognition Letters, 2019, 129(1): 144.
[20] Hang R, Zhou F, Liu Q, et al. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(2): 1424.
[21] Li X, Yuan Z, Wang Q. Remote Sensing, 2019, 11(3): 386.
[22] Bruzzone L, Liu S, Bovolo F, et al. Multitemporal Remote Sensing. Berlin: Springer International Publishing, 2016.
[23] Bigdeli B, Samadzadegan F, Reinartz P. Journal of Applied Remote Sensing, 2014, 8(1): 083509.
[24] Johnson R D, Kasischke E S. International Journal of Remote Sensing, 1998, 19(3): 411.
[25] Zhuang H，Deng K, Fan H, et al. IEEE Geoscience & Remote Sensing Letters, 2017, 13(5): 681.
[26] Thonfeld F, Feilhauer H, Braun M H, et al. International Journal of Applied Earth Observation and Geoinformation, 2016, 50(1): 131.
[27] Adar S, Shkolnisky Y, Dor E B. IEEE Geoscience and Remote Sensing Symposium, IEEE, 2012, 7: 4966.
[28] Yang Z, Mueller R. Spatial-Spectral Cross-Correlation for Change Detection: A Case Study for Citrus Coverage Change Detection. ASPRS Annual Conference, Tampa, Florida, 2007, 5: 7.
[29] Vongsy K, Mendenhall M J, Hanna P M, et al. Change Detection Using Synthetic Hyperspectral Imagery, Workshop on Hyperspectral Image & Signal Processing: Evolution in Remote Sensing. IEEE, 2009, doi: 10.1109/whispers.2009.5289016.
[30] Nielsen A A, Canty M J. Multi-and Hyperspectral Remote Sening Change Detection with Generalized Difference Images by the IR-MAD Method. International Workshop on Analysis of Multi-Temporal Remote Sensing Images, IEEE, 2005, 169. doi: 10.1109/AMTRSI. 2005.1469864.
[31] Liu S C, Du Q, Tong X H, et al. Remote Sensing, 2017, 9(10): 1008.
[32] DU Bo, ZHANG Le-fei, ZHANG Liang-pei, et al(杜 博, 张乐飞, 张良培，等). Acta Photonica Sinica(光子学报), 2013, 42(3): 320.
[33] WU Chen, DU Bo, ZHANG Liang-pei(武 辰, 杜 博, 张良培). National Remote Sensing Bulletin(遥感学报), 2012, 16(3): 545.
[34] Wu C, Du B, Zhang L. Slow Feature Analysis for Hyperspectral Change Detection, IEEE Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing. IEEE, 2014, 1. doi: 10.1109/WHISPERS.2014.8077588.
[35] Ortiz-Rivera V, Velez-Reyers M, Roysam B. Proc SPIE, 2006, 6233: 623312.
[36] Nielsen A A. IEEE Transactions on Image Processing, 2007, 16(2): 463.
[37] Liu S, Bruzzone L, Bovolo F, et al. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(8): 4363.
[38] LIN Yu-kun, WANG Nan, ZHANG Li-fu, et al(林昱坤, 王 楠, 张立福，等). National Remote Sensing Bulletin(遥感学报), 2019, 23(6): 1167.
[39] Hou Z, Li W, Li L, et al. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1(doi: 10.1109/TGRS.2021.3090802).
[40] Wang X, Song R, Song C, et al. IEEE Access, 2018, 6(10): 66007.
[41] Bruzzone L. IEEE Transactions on Geoscience and Remote Sensing, 2000, 38(3): 1171.
[42] Bruzzone L, Prieto D F. International Journal of Remote Sensing, 2000, 21(18): 3539.
[43] Bovolo F, Bruzzone L. IEEE Transactions on Geoscience and Remote Sensing, 2007, 45(1): 218.
[44] Verdier G, Hilgert N, Vila J P. Computational Statistics & Data Analysis, 2008, 52(9): 4161.
[45] Kasetkasem T, Varshney P K. IEEE Transactions on Geoscience and Remote Sensing, 2002, 40(8): 1815.
[46] Yang Y, Yan Z. Monitoring and Analyzing of Poyang Lake Wetland Land Use Change Based on RS and GIS, 3rd Annual International Conference on Geo-Informatics in Resource Management & Sustainable Ecosystem, 2016, 1: 213.
[47] Mousazadeh R, Ghaffarzadeh H, Nouri J, et al. Environmental Monitoring and Assessment, 2015, 187(12): 776.
[48] Bovolo F, Marchesi S, Bruzzone L. IEEE Transactions on Geoscience and Remote Sensing，2012, 50 (6): 2196.
[49] LAN Jin-hui, ZOU Jin-lin, HAO Yan-shuang，et al(蓝金辉, 邹金霖, 郝彦爽，等). National Remote Sensing Bulletin(遥感学报), 2018, 22(1): 13.
[50] Bioucas J M, Plaza A, Dobigeon N, et al. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012, 5(2): 354.
[51] Erturk A, Erturk S, Plaza A. Unmixing with SLIC Superpixels for Hyperspectral Change Detection, 2016 IEEE International Geoscience and Remote Sensing Symposium. IEEE, 2016, 3370.
[52] Erturk A, PlazaA. IEEE Geoscience & Remote Sensing Letters, 2015, 12(6): 1252.
[53] Liu S, Bruzzone L, Bovolo F, et al. IEEE International Geoscience and Remote Sensing Symposium. IEEE, 2015, 9(2): 4165.
[54] Erturk A, Iordache M D, Plazsa A. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016, 9(2): 708.
[55] Lu X, Yuan Y, Zheng X T, et al. IEEE Transactions on Cybernetics, 2017, 47(4): 884.
[56] Seydi S T, Shan H R, Hasanlou M. Appl Geomat, 2021，(12): 763.
[57] ZHU Mo-yan, HOU Jing-wei, SUN Shi-qin, et al(朱默研, 侯景伟, 孙诗琴, 等). Geomatics & Spatial Information Technology(测绘与空间地理信息), 2021, 44(5): 67.
[58] Lei Y, Peng D, Zhang P, et al. IEEE Transactions on Image Processing, 2021, 30(1): 55.
[59] Mou L, Bruzzone L, Zhu X. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(2): 924.
[60] Saad O M, Inoue K, Shalaby A, et al. IEEE Geoscience and Remote Sensing Letters, 2018, 15(11): 1687.
[61] Mostafa M S, Mohamed S, Ahmed S, et al. Journal of Applied Remote Sensing, 2021, 15(2): 028505.
[62] Wang Q, Yuan Z, Du Q, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(1): 3.
[63] Zhao W, Wang Z, Gong M, et al. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(12): 7066.
[64] Du B, Ru L, Wu C, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(12): 9976.
[65] Huang J, Liu K, Xu M, et al. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 8113. doi: 10.1109/JSTARS.2021.3103858.
[66] ZHAO Chun-hui, ZHANG Jin-lin, SU Nan, et al(赵春晖，张锦林，宿 南，等). Journal of Harbin Engineering University(哈尔滨工程大学学报)，2020，41(9)：7.
[67] Hua Z, Li X, Feng Y, et al. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1. doi: 10.1109/LGRS.2021.3091858.
[68] Yu C, Han R, Song M, et al. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing，2020, 13(4): 2485.
[69] Mei S, Ji J, Geng Y, et al. IEEE Transactions on Geoscience & Remote Sensing, 2019, 57(9): 6808.
[70] Ghamisi P, Maggiori S, Li R, et al. IEEE Geoscience and Remote Sensing Magazine, 2018, 6(3): 10.
[71] He J, Zhao H, Yang M, et al. IEEE Transactions on Geoscience & Remote Sensing, 2020, 58(1): 165.
[72] Ma W, Shen L, Sun G, et al. Remote Sensing, 2019, 11(11): 1307.
[73] Daudt R C, Le Saux B, et al. Guided Anisotropic Diffusion and Iterative Learning for Weakly Supervised Change Detection, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Los Angeles, 2019, 1461.
[74] Liu B, Yu X, Yu A, et al. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(4): 2290.
[75] Li Y, Zhang L, Wei W, et al. Deep Self-Supervised Learning for Few-Shot Hyperspectral Image Classification, 2020 IEEE International Geoscience and Remote Sensing Symposium, 2020, 501.
[76] Haut J M, Paoletti M E, Plaze J, et al. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(11): 6440.
[77] Castro R M, Nowak R D. IEEE Transactions on Information Theory, 2007, 54(5): 151.
[78] Tan K, Wang X, Zhu J, et al. International Journal of Remote Sensing, 2018, 39(9-10): 3029.
[79] Tsou Y L, Lin H T. Machine Learning, 2019, 108(5): 785.
[80] Song R, Feng Y, Cheng W, et al. Applied Soft Computing, 2022, 125: 109130.
