Universal High Fidelity Spectral Image Compression Based on Color
Perception
LIANG Wei1, 2, CAI Lei1, 2, HAO Wen1, 2, JIN Hai-yan1, 2, HOU Yu3
1. School of Computer Science and Engineering, Xi'an University of Technology, Xi'an 710048, China
2. Shaanxi Key Laboratory for Network Computing and Security Technology, Xi'an 710048, China
3. Basic Department, Army Engineering University of Chinese People's Liberation Army, Nanjing 211101, China
Abstract:Aiming at the application of spectral images in the fields of color high fidelity reproduction in specific reproduction environments, this paper proposes universal low-complexity, color-high-fidelity spectral image compression methods based on visual characteristics in specific illumination, which could enhance algorithms' versatility, improve compression efficiency, and further facilitate images' storage and transmission. This paper first studies the color reproduction principle of spectral images in specific reproduction environments, designs a measurement method for the color error of reconstructed spectral images, and then proposes distortion guidelines for spectral image color fidelity compression in specific illumination. Based on the color distortion guidelines, the compression principle is derived. Then spectral preprocessing, spatial-spectral de-redundancy methods, encoding methods, and optimization strategies are designed, and finally, spectral image compression methods for high-fidelity reproduction are proposed. In terms of distortion guidance criteria, first the color decomposition environment of spectral images is constructed, and a matrix operator is proposed to extract color perception information from spectral images under specific lighting (single or mixed lighting); then, through the color perception information extraction operator, color perception error is used to measure the deviation of spectral images in the color measurement; finally, the color perception distortion criterion of the spectral image is proposed to guide the compression process. Based on this criterion, a targeted compression principle is proposed, and the compression flow of this paper is designed. First, the color perception weighted preprocessing of the spectral data is performed, and the color perception information extraction operator is used to obtain spectral color perception data under specific reproduction conditions that still maintains spectral characteristics; then, based on the color perception compression principle, APWS-RA encoding is performed on the color perception spectral data. The method is named WSF-APWS-RA. Spectral image decoding is divided into two stages. First, the compressed bit stream is encoded inversely to form a reconstructed spectral color perception data matrix; then, the reconstructed spectral image is obtained by multiplying the inverse matrix of the perception information extraction operator and the reconstructed spectral color perception data matrix. Experiments show that at the same bit rate, compared with the existing low-complexity APWS, APWS-RA, and universal color-high-fidelity WF-APWS-RA compression, WsF-APWS-RA codings can not only more effectively retain spectral color information under specific reproduction conditions, but also have the best variable illumination color reproduction stability. Meanwhile, it can also effectively improve the accuracy of spectral reconstruction. Therefore, the new methods can also be generalized to remote sensing and other fields, and have important practical value.
Key words:Visible spectrum; Spectral image compression; High-fidelity color reproduction; Color perception information extraction; Wavelet codec
[1] Hernández-Cabronero M, Kiely A B, Klimesh M, et al. IEEE Geoscience and Remote Sensing Magazine, 2021, 9(4): 102.
[2] Prakash A, Moran N, Garber S, et al. Semantic Perceptual Image Compression Using Deep Convolution Networks. 2017 Data Compression Conference (DCC), 2017, 250.
[3] Kong F, Hu K, Li Y, et al. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 2745.
[4] Guo Y, Tao Y, Chong Y, et al. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 1.
[5] Ma L, Qiu X, Cong Y. MIPPR 2015: Multispectral Image Acquisition, Processing, and Analysis, 2015, 9811: 98110C.
[6] Wu G, Liu Z, Yang S, et al. Journal of Spectroscopy, 2014, 2014(1): 595602.
[7] Lv C, Li C, Xiao K, et al. Optics Express, 2022, 30(22): 40144.
[8] Liang W, Hao W, Jin H, et al. Spectroscopy Letters, 2021, 54(5): 395.
[9] Le Moan S, Blahová J, Urban P, et al. Journal of Imaging Science and Technology, 2016, 60(6): 060501.
[10] Zhang X, Wang Q, Wang Y, et al. Optics Letters, 2012, 37(24): 5097.
[11] Shinoda K, Murakami Y, Yamaguchi M, et al. Journal of Electronic Imaging, 2011, 20(2): 023003.
[12] LIANG Wei, ZENG Ping, LUO Xue-mei, et al(梁 玮, 曾 平, 罗雪梅, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2015, 35(1): 276.