Proceedings

Active Diffusion-Based Inference for Ill-Posed Inverse Problems Under Incomplete Priors

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 5119-5127.

https://doi.org/10.24963/ijcai.2026/570

Abstract

Many scientific and engineering applications require estimating unknown parameters from experimentally observable data -- an inverse problem that is inherently challenging due to nonlinearity, noise, and ill-posedness. In this paper, we propose an active diffusion-based inverse problem solver. A diffusion model is trained to learn the mapping between the parameter space and the observable space. By iteratively detecting and correcting model misspecification through posterior uncertainty, the method discovers and learns the correct region of parameter space, even when initial training bounds exclude the true parameters. This provides a principled, Bayesian justification for adaptive domain augmentation and ensures robust inference for inverse problems under incomplete prior knowledge. We demonstrate the effectiveness of our inverse solver for a toy inverse problem with infinite solutions, and for the parameterization of the quantum correlation functions to event observables in a Quantum Chromodynamics analysis of nucleon structure.

  1. [Adler and Öktem, 2017] Jonas Adler and Ozan Öktem. Solving ill-posed inverse problems using iterative deep neural networks. Inverse Problems, 33(12):124007, 2017.
  2. [Alghamdi et al., 2025] Tareq Alghamdi, Jitao Xu, Nesar Ramachandra, Nobuo Sato, and Yaohang Li. Towards an event-level analysis in hadronic physics using generative ai-based surrogates. In Proceedings of The IEEE Inter- national Conference on Tools with Artificial Intelligence (ICTAI2025), 2025.
  3. [Almaeen et al., 2021] Manal Almaeen, Yasir Alanazi, Nobuo Sato, W. Melnitchouk, Michelle P. Kuchera, and Yaohang Li. Variational autoencoder inverse mapper: An end-to-end deep learning framework for inverse problems. In Proceedings of 2021 International Joint Conference on Neural Networks (IJCNN), pages 1-8, 2021.
  4. [Almaeen et al., 2025] Manal Almaeen, Tareq Alghamdi, Brandon Kriesten, Douglas Adams, Yaohang Li, Huey- Wen Lin, and Simonetta Liuti. Vaim-cff: a variational autoencoder inverse mapper solution to compton form fac- tor extraction from deeply virtual exclusive reactions. Eur. Phys. J. C, 85:449, 2025.
  5. [Ardizzone et al., 2019] Lynton Ardizzone, Jakob Kruse, Carsten Rother, and Ullrich Köthe. Analyzing inverse problems with invertible neural networks. In Proceedings of 7th International Conference on Learning Representa- tions, 2019.
  6. [Arridge et al., 2019] Simon Arridge, Peter Maass, Ozan Öktem, and Carola-Bibiane Schönlieb. Solving inverse problems using data-driven models. Acta Numerica, 28:1-174, 2019.
  7. [Bishop and Nasrabadi, 2006] Christopher M Bishop and Nasser M Nasrabadi. Pattern recognition and machine learning, volume 4. Springer, 2006.
  8. [Bishop, 1994] Christopher M. Bishop. Mixture density net- works. Working paper, Aston Univ., 1994.
  9. [Chung et al., 2022] Hyungjin Chung, Jeongsol Kim, Michael T Mccann, Marc L Klasky, and Jong Chul Ye. Diffusion posterior sampling for general noisy inverse problems. arXiv preprint arXiv:2209.14687, 2022.
  10. [Cocuzza et al., 2022] Christopher Cocuzza, Wally Mel- nitchouk, Andreas Metz, Nobuo Sato, and (Jefferson Lab Angular Momentum (JAM) Collaboration). Polarized an- timatter in the proton from a global qcd analysis. Physical Review D, 106(3):L031502, 2022.
  11. [Colton et al., 2000] David Colton, Heinz W. Engl, Al- fred K. Louis, Joyce R. McLaughlin, and William Run- dell. Surveys on Solution Methods for Inverse Problems. Springer, 2000.
  12. [Dinh et al., 2014] Laurent Dinh, David Krueger, and Yoshua Bengio. Nice: Non-linear independent compo- nents estimation. arXiv preprint arXiv:1410.8516, 2014.
  13. [Foucart and Rauhut, 2013] Simon Foucart and Holger Rauhut. A Mathematical Introduction to Compressive Sensing. Birkhäuser, 2013.
  14. [Ho et al., 2020] Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840-6851, 2020.
  15. [Kawar et al., 2022] Bahjat Kawar, Michael Elad, Stefano Ermon, and Jiaming Song. Denoising diffusion restora- tion models. Advances in neural information processing systems, 35:23593-23606, 2022.
  16. [Kingma and Ba, 2017] Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization, 2017.
  17. [Kruse et al., 2025] Carola Kruse, Masha Sosonkina, Md Fayaz Bin Hossen, and Yaohang Li. Material param- eter estimation for a viscoelastic stenosis model using a variational autoencoder inverse mapper. Journal of Inverse and Ill-posed Problems, 33(5):617-632, 2025.
  18. [Li et al., 2020] Housen Li, Johannes Schwab, Stephan An- tholzer, and Markus Haltmeier. NETT: Solving inverse problems with deep neural networks. Inverse Problems, 36(6):065005, 2020.
  19. [Nalisnick et al., 2018] Eric Nalisnick, Akihiro Matsukawa, Yee Whye Teh, Dilan Gorur, and Balaji Lakshmi- narayanan. Do deep generative models know what they don't know? arXiv preprint arXiv:1810.09136, 2018.
  20. [Qi et al., 2017] Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 652-660, 2017.
  21. [Rezende and Mohamed, 2015] Danilo Rezende and Shakir Mohamed. Variational inference with normalizing flows. In International conference on machine learning, pages 1530-1538. PMLR, 2015.
  22. [Rodgers, 2000] Clive D Rodgers. Inverse methods for atmo- spheric sounding: theory and practice, volume 2. World scientific, 2000.
  23. [Settles, 2009] Burr Settles. Active learning literature sur- vey. 2009.
  24. [Sohl-Dickstein et al., 2015] Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermody- namics. In International conference on machine learning, pages 2256-2265. pmlr, 2015.
  25. [Song and Ermon, 2019] Yang Song and Stefano Ermon. Generative modeling by estimating gradients of the data distribution. Advances in neural information processing systems, 32, 2019.
  26. [Song et al., 2020] Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020.
  27. [Spaeth and Li, 2025] Peter W. Spaeth and Yaohang Li. Es- timate composite bond line properties in composite struc- tures using variational autoencoder inverse mapper. In Giovanni Ferrarini, Peter Spaeth, and Fernando López, ed- itors, Thermosense: Thermal Infrared Applications XLVII, volume 13470, page 134700Q. International Society for Optics and Photonics, SPIE, 2025.
  28. [Stoer et al., 1980] Josef Stoer, Roland Bulirsch, R Bartels, Walter Gautschi, and Christoph Witzgall. Introduction to numerical analysis, volume 1993. Springer, 1980.
  29. [Tarantola, 2005] Albert Tarantola. Inverse problem theory and methods for model parameter estimation. SIAM, 2005.
  30. [Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in Neural Information Processing Sys- tems, volume 30, 2017.
  31. [Yu et al., 2017] Wenjian Yu, Yu Gu, Jian Li, Shenghua Liu, and Yaohang Li. Single-pass PCA of large high- dimensional data. In Proceedings of 26th International Joint Conference on Artificial Intelligence, (IJCAI), 2017.
  32. [Yuan et al., 2020] Qiangqiang Yuan, Huanfeng Shen, Tong- wen Li, Zhiwei Li, Shuwen Li, Yun Jiang, Hongzhang Xu, Weiwei Tan, Qianqian Yang, Jiwen Wang, et al. Deep learning in environmental remote sensing: Achieve- ments and challenges. Remote sensing of Environment, 241:111716, 2020.
  33. [Zhang et al., 2021] Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understand- ing deep learning (still) requires rethinking generalization. Communications of the ACM, 64(3):107-115, 2021.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards