{"type":"ScholarlyArticle","title":"Hyperspectral Image Denoising Using Uncertainty-Aware Adjustor","authors":[{"name":"Jiahua Xiao","slug":"jiahua-xiao","given":"Jiahua","family":"Xiao","affiliation":"School of Software Engineering , Xi'an Jiaotong University"},{"name":"Xing Wei","slug":"xing-wei","given":"Xing","family":"Wei","affiliation":"School of Software Engineering , Xi'an Jiaotong University"}],"abstract":"Hyperspectral image (HSI) denoising has achieved promising results with the development of deep learning. A mainstream class of methods exploits the spatial-spectral correlations and recovers each band with the aids of neighboring bands, collectively referred to as spectral auxiliary networks. However, these methods treat entire adjacent spectral bands equally. In theory, clearer and nearer bands  tend to contain more reliable spectral information than noisier and farther ones with higher uncertainties. How to achieve spectral enhancement and adaptation of each adjacent band has become an urgent problem in HSI denoising. This work presents the UA-Adjustor, a comprehensive adjustor that enhances denoising performance by considering both the band-to-pixel and enhancement-to-adjustment aspects. Specifically, UA-Adjustor consists of three stages that evaluate the importance of neighboring bands, enhance neighboring bands based on uncertainty perception, and adjust the weight of spatial pixels in adjacent bands through estimated uncertainty. For its simplicity, UA-Adjustor can be flexibly plugged into existing spectral auxiliary networks to improve denoising behavior at low cost. Extensive experimental results validate that the proposed solution can improve over recent state-of-the-art (SOTA) methods on both simulated and real-world benchmarks by a large margin.","doi":"10.24963/ijcai.2023/173","url":"https://ijcai.org/proceedings/2023/173","pdf":"https://ijcai.org/proceedings/2023/0173.pdf","markdown":"https://ijcai.org/proceedings/2023/173.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/173","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Computer Vision","track":"Main Track","number":173,"pages":{"first":1560,"last":1568},"keywords":["Computer Vision: CV: Applications","Computer Vision: CV: Computational photography"],"videos":[],"references":[{"position":1,"raw":"[Arad and Ben-Shahar, 2016] Boaz Arad and Ohad Ben- Shahar. Sparse recovery of hyperspectral signal from nat- ural rgb images. In European Conference on Computer Vision, pages 19-34. Springer, 2016.","title":"Sparse recovery of hyperspectral signal from natural rgb images","authors":"Ben-Shahar ; Arad, Arad Boaz, Ohad Ben-Shahar","year":"2016","venue":"European Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cai et al., 2021a] Weiwei Cai, Zhanguo Wei, Runmin Liu, Yuan Zhuang, Yan Wang, and Xin Ning. Remote sensing image recognition based on multi-attention residual fusion networks. ASP Transactions on Pattern Recognition and Intelligent Systems, 1(1):1-8, 2021.","title":"Remote sensing image recognition based on multi-attention residual fusion networks","authors":"Cai","year":"2021","venue":"ASP Transactions on Pattern Recognition and Intelligent Systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cai et al., 2021b] Yuanhao Cai, Xiaowan Hu, Haoqian Wang, Yulun Zhang, Hanspeter Pfister, and Donglai Wei. Learning to generate realistic noisy images via pixel-level noise-aware adversarial training. Advances in Neural In- formation Processing Systems, 34:3259-3270, 2021.","title":"Learning to generate realistic noisy images via pixel-level noise-aware adversarial training","authors":"Cai","year":"2021","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cai et al., 2022a] Yuanhao Cai, Jing Lin, Xiaowan Hu, Haoqian Wang, Xin Yuan, Yulun Zhang, Radu Timofte, and Luc Van Gool. Mask-guided spectral-wise transformer for efficient hyperspectral image reconstruction. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17502-17511, 2022.","title":"Mask-guided spectral-wise transformer for efficient hyperspectral image reconstruction","authors":"Cai","year":"2022","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Cai et al., 2022b] Yuanhao Cai, Jing Lin, Haoqian Wang, Xin Yuan, Henghui Ding, Yulun Zhang, Radu Timo- fte, and Luc V Gool. Degradation-aware unfolding half-shuffle transformer for spectral compressive imag- ing. Advances in Neural Information Processing Systems, 35:37749-37761, 2022.","title":"Degradation-aware unfolding half-shuffle transformer for spectral compressive imaging","authors":"Cai","year":"2022","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cao et al., 2021] Xiangyong Cao, Xueyang Fu, Chen Xu, and Deyu Meng. Deep spatial-spectral global reason- ing network for hyperspectral image denoising. IEEE Transactions on Geoscience and Remote Sensing, 60:1- 14, 2021.","title":"Deep spatial-spectral global reasoning network for hyperspectral image denoising","authors":"Cao","year":"2021","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Guan et al., 2022] Juntao Guan, Rui Lai, Huanan Li, Yin- tang Yang, and Lin Gu. Dnrcnn: Deep recurrent convo- lutional neural network for hsi destriping. IEEE Transac- tions on Neural Networks and Learning Systems, 2022.","title":"Dnrcnn: Deep recurrent convolutional neural network for hsi destriping","authors":"Juntao Guan, Rui Lai, Huanan Li, Yintang Yang, Lin Gu","year":"2022","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Hong et al., 2021] Danfeng Hong, Zhu Han, Jing Yao, Lianru Gao, Bing Zhang, Antonio Plaza, and Jocelyn Chanussot. Spectralformer: Rethinking hyperspectral im- age classification with transformers. IEEE Transactions on Geoscience and Remote Sensing, 60:1-15, 2021.","title":"Spectralformer: Rethinking hyperspectral image classification with transformers","authors":"Danfeng Hong, Zhu Han, Jing Yao, Lianru Gao, Bing Zhang, Antonio Plaza, Jocelyn Chanussot","year":"2021","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hu et al., 2018] Jie Hu, Li Shen, and Gang Sun. Squeeze- and-excitation networks. In Proceedings of the IEEE con- ference on computer vision and pattern recognition, pages 7132-7141, 2018.","title":"Squeezeand-excitation networks","authors":"Jie Hu, Li Shen, Gang Sun","year":"2018","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kan et al., 2022] Ziwen Kan, Suhang Li, Mingzheng Hou, Leyuan Fang, and Yi Zhang. Attention-based octave net- work for hyperspectral image denoising. IEEE Journal of Selected Topics in Applied Earth Observations and Re- mote Sensing, 15:1089-1102, 2022.","title":"Attention-based octave network for hyperspectral image denoising","authors":"Kan","year":"2022","venue":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Landgrebe, 2003] David A Landgrebe. Signal theory meth- ods in multispectral remote sensing, volume 24. John Wi- ley & Sons, 2003.","title":"Signal theory methods in multispectral remote sensing","authors":"David A Landgrebe","year":"2003","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Liu et al., 2021] Jun Liu, Zengfu Hou, Wei Li, Ran Tao, Danilo Orlando, and Hongbin Li. Multipixel anomaly de- tection with unknown patterns for hyperspectral imagery. IEEE Transactions on Neural Networks and Learning Sys- tems, 2021.","title":"Multipixel anomaly detection with unknown patterns for hyperspectral imagery","authors":"Jun Liu, Zengfu Hou, Wei Li, Ran Tao, Danilo Orlando, Hongbin Li","year":"2021","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Maffei et al., 2019] Alessandro Maffei, Juan M Haut, Mer- cedes Eugenia Paoletti, Javier Plaza, Lorenzo Bruzzone, and Antonio Plaza. A single model cnn for hyperspectral image denoising. IEEE Transactions on Geoscience and Remote Sensing, 58(4):2516-2529, 2019.","title":"A single model cnn for hyperspectral image denoising","authors":"Alessandro Maffei, Juan M Haut, Mercedes Eugenia Paoletti, Javier Plaza, Lorenzo Bruzzone, Antonio Plaza","year":"2019","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mnih and Hinton, 2010] Volodymyr Mnih and Geoffrey E Hinton. Learning to detect roads in high-resolution aerial images. In European conference on computer vision, pages 210-223. Springer, 2010.","title":"Learning to detect roads in high-resolution aerial images","authors":"Hinton Mnih, Volodymyr Mnih, Geoffrey E Hinton","year":"2010","venue":"European conference on computer vision","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Park et al., 2007] Jong-Il Park, Moon-Hyun Lee, Michael D Grossberg, and Shree K Nayar. Multispectral imaging us- ing multiplexed illumination. In 2007 IEEE 11th Interna- tional Conference on Computer Vision, pages 1-8. IEEE, 2007.","title":"Multispectral imaging using multiplexed illumination","authors":"Jong-Il Park, Moon-Hyun Lee, Michael D Grossberg, Shree K Nayar","year":"2007","venue":"IEEE 11th International Conference on Computer Vision","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Pedregosa et al., 2011] Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. Scikit-learn: Machine learning in python. the Journal of machine Learning re- search, 12:2825-2830, 2011.","title":"Scikit-learn: Machine learning in python","authors":"Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg","year":"2011","venue":"the Journal of machine Learning research","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Rui et al., 2021] Xiangyu Rui, Xiangyong Cao, Qi Xie, Zongsheng Yue, Qian Zhao, and Deyu Meng. Learning an explicit weighting scheme for adapting complex hsi noise. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6739-6748, 2021.","title":"Learning an explicit weighting scheme for adapting complex hsi noise","authors":"Xiangyu Rui, Xiangyong Cao, Qi Xie, Zongsheng Yue, Qian Zhao, Deyu Meng","year":"2021","venue":"Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wang et al., 2004] Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE transac- tions on image processing, 13(4):600-612, 2004.","title":"Image quality assessment: from error visibility to structural similarity","authors":"Zhou Wang, Alan C Bovik, Hamid R Sheikh, Eero P Simoncelli","year":"2004","venue":"IEEE transactions on image processing","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wei et al., 2020] Kaixuan Wei, Ying Fu, and Hua Huang. 3-d quasi-recurrent neural network for hyperspectral im- age denoising. IEEE transactions on neural networks and learning systems, 32(1):363-375, 2020.","title":"3-d quasi-recurrent neural network for hyperspectral image denoising","authors":"Kaixuan Wei, Ying Fu, Hua Huang","year":"2020","venue":"IEEE transactions on neural networks and learning systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wei et al., 2023] Xing Wei, Jiahua Xiao, and Yihong Gong. Blind hyperspectral image denoising with degradation in- formation learning. Remote Sensing, 15(2):490, 2023.","title":"Blind hyperspectral image denoising with degradation information learning","authors":"Xing Wei, Jiahua Xiao, Yihong Gong","year":"2023","venue":"Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Yuan et al., 2018] Qiangqiang Yuan, Qiang Zhang, Jie Li, Huanfeng Shen, and Liangpei Zhang. Hyperspectral im- age denoising employing a spatial-spectral deep residual convolutional neural network. IEEE Transactions on Geo- science and Remote Sensing, 57(2):1205-1218, 2018.","title":"Hyperspectral image denoising employing a spatial-spectral deep residual convolutional neural network","authors":"Qiangqiang Yuan, Qiang Zhang, Jie Li, Huanfeng Shen, Liangpei Zhang","year":"2018","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Yuan et al., 2021] Yuan Yuan, Hanwen Ma, and Ganchao Liu. Partial-dnet: A novel blind denoising model with noise intensity estimation for hsi. IEEE Transactions on Geoscience and Remote Sensing, 60:1-13, 2021.","title":"Partial-dnet: A novel blind denoising model with noise intensity estimation for hsi","authors":"Yuan Yuan, Hanwen Ma, Ganchao Liu","year":"2021","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Yuhas et al., 1993] Roberta H Yuhas, Joseph W Boardman, and Alexander FH Goetz. Determination of semi-arid landscape endmembers and seasonal trends using convex geometry spectral unmixing techniques. In JPL, Sum- maries of the 4th Annual JPL Airborne Geoscience Work- shop. Volume 1: AVIRIS Workshop, 1993.","title":"Determination of semi-arid landscape endmembers and seasonal trends using convex geometry spectral unmixing techniques","authors":"Roberta H Yuhas, Joseph W Boardman, Alexander Fh Goetz","year":"1993","venue":"JPL, Summaries of the 4th Annual JPL Airborne Geoscience Workshop","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zhang et al., 2019] Qiang Zhang, Qiangqiang Yuan, Jie Li, Xinxin Liu, Huanfeng Shen, and Liangpei Zhang. Hy- brid noise removal in hyperspectral imagery with a spa- tial-spectral gradient network. IEEE Transactions on Geo- science and Remote Sensing, 57(10):7317-7329, 2019.","title":"Hybrid noise removal in hyperspectral imagery with a spatial-spectral gradient network","authors":"Qiang Zhang, Qiangqiang Yuan, Jie Li, Xinxin Liu, Huanfeng Shen, Liangpei Zhang","year":"2019","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zhong et al., 2021] Zilong Zhong, Ying Li, Lingfei Ma, Jonathan Li, and Wei-Shi Zheng. Spectral-spatial trans- former network for hyperspectral image classification: A factorized architecture search framework. IEEE Transac- tions on Geoscience and Remote Sensing, 60:1-15, 2021.","title":"Spectral-spatial transformer network for hyperspectral image classification: A factorized architecture search framework","authors":"Zilong Zhong, Ying Li, Lingfei Ma, Jonathan Li, Wei-Shi Zheng","year":"2021","venue":"IEEE Transactions on Geoscience and Remote Sensing","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}