Proceedings

Amortized Multi-Objective Optimization Across Tasks with Generative Solution Modeling

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 6361-6369.

https://doi.org/10.24963/ijcai.2026/708

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

Many real-world applications require solving families of expensive multi-objective optimization problems~(EMOPs) under varying operational conditions. This can be formulated as parametric expensive multi-objective optimization problems (P-EMOPs) where each task parameter defines a distinct optimization instance. Current multi-objective Bayesian optimization methods have been widely used for finding finite sets of Pareto optimal solutions for each task. However, P-EMOPs present a fundamental challenge: the continuous task parameter space can contain infinite distinct problems, each requiring separate expensive evaluations. To address this, we propose learning an inverse model to amortize the multi-objective optimization cost across the continuous task-preference space, enabling direct solution prediction for any query without the need for expensive re-evaluation. This paper introduces a novel parametric multi-objective Bayesian optimizer that learns this inverse model by alternating between (1) generative solution sampling via conditional generative models and (2) acquisition-driven search leveraging inter-task synergies. This approach enables effective optimization across multiple tasks and finally achieves direct solution prediction for unseen parameterized EMOPs without re-evaluations. We theoretically justify the faster convergence by leveraging inter-task synergies through task-aware Gaussian processes. Based on that, empirical studies in synthetic and real-world benchmarks further verify the effectiveness of the proposed parametric optimizer.

  1. [Balandat et al., 2020] Maximilian Balandat, Brian Karrer, Daniel Jiang, Samuel Daulton, Ben Letham, Andrew G Wilson, and Eytan Bakshy. Botorch: A framework for ef- ficient monte-carlo bayesian optimization. In Advances in Neural Information Processing Systems, volume 33, pages 21524-21538.
  2. Curran Associates, Inc., 2020.
  3. [Bali et al., 2021] Kavitesh Kumar Bali, Abhishek Gupta, Yew-Soon Ong, and Puay Siew Tan. Cognizant multitask- ing in multiobjective multifactorial evolution: Mo-mfea-ii. IEEE Trans. on Cybern., 51(4):1784-1796, 2021.
  4. [Belakaria et al., 2019] Syrine Belakaria, Aryan Deshwal, and Janardhan Rao Doppa. Max-value entropy search for multi-objective bayesian optimization. In Advances in Neural Information Processing Systems, volume 32. Cur- ran Associates, Inc., 2019.
  5. [Branke, 2008] Jürgen Branke. Multiobjective optimization: Interactive and evolutionary approaches, volume 5252. Springer Science & Business Media, 2008.
  6. [Brookes et al., 2019] David Brookes, Hahnbeom Park, and Jennifer Listgarten. Conditioning by adaptive sampling for robust design. In Proceedings of the 36th Interna- tional Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, pages 773- 782. PMLR, 09-15 Jun 2019.
  7. [Char et al., 2019] Ian Char, Youngseog Chung, Willie Neiswanger, Kirthevasan Kandasamy, Andrew Oakleigh Nelson, Mark Boyer, Egemen Kolemen, and Jeff Schnei- der. Offline contextual Bayesian optimization. In Ad- vances in Neural Information Processing Systems, vol- ume 32.
  8. Curran Associates, Inc., 2019.
  9. [Cheng et al., 2025a] Ji Cheng, Xi Lin, Bo Xue, and Qingfu Zhang. Parametric pareto set learning: Amortizing multi- objective optimization with parameters. IEEE Transac- tions on Evolutionary Computation, pages 1-1, 2025.
  10. [Cheng et al., 2025b] Ji Cheng, Bo Xue, and Qingfu Zhang. Parametric pareto set learning for expensive multi- objective optimization, 2025.
  11. [Cully et al., 2015] Antoine Cully, Jeff Clune, Danesh Tara- pore, and Jean-Baptiste Mouret. Robots that can adapt like animals. Nature, 521(7553):503-507, May 2015.
  12. [Daulton et al., 2020] Samuel Daulton, Maximilian Balan- dat, and Eytan Bakshy. Differentiable expected hyper- volume improvement for parallel multi-objective bayesian optimization. Advances in Neural Information Processing Systems, 33:9851-9864, 2020.
  13. [Deb et al., 2002] K. Deb, L. Thiele, M. Laumanns, and E. Zitzler. Scalable multi-objective optimization test prob- lems. In Proceedings of the 2002 Congress on Evolu- tionary Computation. CEC'02, volume 1, pages 825-830 vol.1, 2002.
  14. [Emmerich et al., 2006] M.T.M. Emmerich, K.C. Gian- nakoglou, and B. Naujoks. Single-and multiobjective evo- lutionary optimization assisted by gaussian random field metamodels. IEEE Trans. on Evol. Comput., 10(4):421- 439, 2006.
  15. [Gupta et al., 2016a] Abhishek Gupta, Yew-Soon Ong, and Liang Feng. Multifactorial evolution: toward evolutionary multitasking. IEEE Trans. on Evol. Comput., 20(3):343- 357, 2016.
  16. [Gupta et al., 2016b] Abhishek Gupta, Yew-Soon Ong, Liang Feng, and Kay Chen Tan. Multiobjective multi- factorial optimization in evolutionary multitasking. IEEE Trans. on Cybern., 47(7):1652-1665, 2016.
  17. [Hernandez-Lobato et al., 2016] Daniel Hernandez-Lobato, Jose Hernandez-Lobato, Amar Shah, and Ryan Adams. Predictive entropy search for multi-objective bayesian op- timization. In Proceedings of The 33rd International Con- ference on Machine Learning, volume 48 of Proceedings of Machine Learning Research, pages 1492-1501, New York, New York, USA, 20-22 Jun 2016. PMLR.
  18. [Ho et al., 2020] Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems, volume 33, pages 6840-6851.
  19. Curran Associates, Inc., 2020.
  20. [Kandasamy et al., 2015] Kirthevasan Kandasamy, Jeff Schneider, and Barnabas Poczos. High dimensional bayesian optimisation and bandits via additive models. In Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 295-304, Lille, France, 07-09 Jul 2015. PMLR.
  21. [Kim et al., 2021] Yeonju Kim, Zherong Pan, and Kris Hauser. Mo-bbo: Multi-objective bilevel bayesian op- timization for robot and behavior co-design. In 2021 IEEE International Conference on Robotics and Automa- tion (ICRA), pages 9877-9883, 2021.
  22. [Kingma and Welling, 2022] Diederik P Kingma and Max Welling. Auto-encoding variational bayes, 2022.
  23. [Knowles, 2006] J. Knowles. Parego: a hybrid algorithm with on-line landscape approximation for expensive mul- tiobjective optimization problems. IEEE Trans. on Evol. Comput., 10(1):50-66, 2006.
  24. [Li et al., 2024] Beichen Li, Bolei Deng, Wan Shou, Tae- Hyun Oh, Yuanming Hu, Yiyue Luo, Liang Shi, and Wo- jciech Matusik. Computational discovery of microstruc- tured composites with optimal stiffness-toughness trade- offs. Science Advances, 10(5):eadk4284, 2024.
  25. [Li et al., 2025] Bingdong Li, Zixiang Di, Yongfan Lu, Hong Qian, Feng Wang, Peng Yang, Ke Tang, and Aimin Zhou. Expensive multi-objective bayesian optimization based on diffusion models. Proceedings of the AAAI Conference on Artificial Intelligence, 39(25):27063-27071, Apr. 2025.
  26. [Lin et al., 2022] Xi Lin, Zhiyuan Yang, Xiaoyuan Zhang, and Qingfu Zhang. Pareto set learning for expensive multi- objective optimization. In Advances in Neural Information Processing Systems, volume 35, pages 19231-19247.
  27. [Liu et al., 2025] Jiao Liu, Abhishek Gupta, Chinchun Ooi, and Yew-Soon Ong. Extremo: Transfer evolutionary mul- tiobjective optimization with proof of faster convergence. IEEE Trans. on Evol. Comput., 29(1):102-116, 2025.
  28. [Makatura et al., 2021] Liane Makatura, Minghao Guo, Adriana Schulz, Justin Solomon, and Wojciech Matusik. Pareto gamuts: exploring optimal designs across varying contexts. ACM Trans. on Graph., 40(4), July 2021.
  29. [Miettinen, 1999] Kaisa Miettinen. Nonlinear multiobjective optimization, volume 12. Springer Science & Business Media, 1999.
  30. [Min et al., 2019] Alan Tan Wei Min, Yew-Soon Ong, Ab- hishek Gupta, and Chi-Keong Goh. Multiproblem surro- gates: Transfer evolutionary multiobjective optimization of computationally expensive problems. IEEE Trans.on Evol. Comput., 23(1):15-28, 2019.
  31. [Nickelson et al., 2023] Anna Nickelson, Kagan Tumer, and William D. Smart. Contextual multi-objective path plan- ning. In 2023 IEEE International Conference on Robotics and Automation (ICRA), pages 10240-10246, 2023.
  32. [Ozaki et al., 2022] Yoshihiko Ozaki, Yuki Tanigaki, Shuhei Watanabe, Masahiro Nomura, and Masaki Onishi. Mul- tiobjective tree-structured parzen estimator. J. Artif. Int. Res., 73, May 2022.
  33. [Paria et al., 2020] Biswajit Paria, Kirthevasan Kandasamy, and Barnabás Póczos. A flexible framework for multi- objective bayesian optimization using random scalariza- tions. In Proceedings of The 35th Uncertainty in Artifi- cial Intelligence Conference, volume 115 of Proceedings of Machine Learning Research, pages 766-776. PMLR, 22-25 Jul 2020.
  34. [Picheny, 2015] Victor Picheny. Multiobjective optimization using gaussian process emulators via stepwise uncertainty reduction. Statistics and Computing, 25(6):1265-1280, 2015.
  35. [Pierrot et al., 2022] Thomas Pierrot, Guillaume Richard, Karim Beguir, and Antoine Cully. Multi-objective qual- ity diversity optimization. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO '22, page 139-147, New York, NY, USA, 2022. Association for Computing Machinery.
  36. [Sohn et al., 2015] Kihyuk Sohn, Honglak Lee, and Xinchen Yan. Learning structured output representation using deep conditional generative models. In Advances in Neural In- formation Processing Systems, volume 28.
  37. [Srinivas et al., 2012] Niranjan Srinivas, Andreas Krause, Sham M. Kakade, and Matthias W. Seeger. Information- theoretic regret bounds for Gaussian process optimization in the bandit setting. IEEE Trans. on Information Theory, 58(5):3250-3265, 2012.
  38. [Tu et al., 2022] Ben Tu, Axel Gandy, Nikolas Kantas, and Behrang Shafei. Joint entropy search for multi-objective bayesian optimization. In Advances in Neural Information Processing Systems, volume 35, pages 9922-9938.
  39. Curran Associates, Inc., 2022.
  40. [Turchetta et al., 2020] Matteo Turchetta, Andreas Krause, and Sebastian Trimpe. Robust model-free reinforcement learning with multi-objective bayesian optimization. In 2020 IEEE International Conference on Robotics and Au- tomation (ICRA), pages 10702-10708, 2020.
  41. [Wei et al., 2022] Tingyang Wei, Shibin Wang, Jinghui Zhong, Dong Liu, and Jun Zhang. A review on evolution- ary multitask optimization: Trends and challenges. IEEE Trans. on Evol. Comput., 26(5):941-960, 2022.
  42. [Wei et al., 2024] Tingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong. Bayesian forward- inverse transfer for multiobjective optimization. In Par- allel Problem Solving from Nature -PPSN XVIII, pages 135-152, Cham, 2024. Springer Nature Switzerland.
  43. [Wei et al., 2025] Tingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong. (θ l ,θ u )-parametric multi-task optimization: Joint search in solution and in- finite task spaces. IEEE Trans. on Evol. Comput., pages 1-1, 2025.
  44. [Williams and Rasmussen, 2006] C. K. Williams and C. E. Rasmussen. Gaussian Processes for Machine Learning. MIT Press, 2006.
  45. [Zhang and Golovin, 2020] Richard Zhang and Daniel Golovin. Random hypervolume scalarizations for provable multi-objective black box optimization. In Proceedings of the 37th International Conference on Ma- chine Learning, volume 119 of Proceedings of Machine Learning Research, pages 11096-11105. PMLR, 13-18 Jul 2020.
  46. [Zhang et al., 2022] Dinghuai Zhang, Jie Fu, Yoshua Ben- gio, and Aaron Courville. Unifying likelihood-free infer- ence with black-box sequence design and beyond. In Inter- national Conference on Learning Representations, 2022.
  47. [Zhu et al., 2023] Yiheng Zhu, Jialu Wu, Chaowen Hu, Ji- ahuan Yan, kim hsieh, Tingjun Hou, and Jian Wu. Sample-efficient multi-objective molecular optimization with gflownets. In Advances in Neural Information Pro- cessing Systems, volume 36, pages 79667-79684.
  48. Curran Associates, Inc., 2023.
  49. [Zitzler and Thiele, 1998] Eckart Zitzler and Lothar Thiele. Multiobjective optimization using evolutionary algorithms -a comparative case study. In Parallel Problem Solving from Nature -PPSN V, pages 292-301, Berlin, Heidel- berg, 1998. Springer Berlin Heidelberg.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards