{"type":"ScholarlyArticle","title":"Combining Constraint Solving and Bayesian Techniques for System Optimization","authors":[{"name":"Franz Brauße","slug":"franz-brau-e","given":"Franz","family":"Brauße","affiliation":"The University of Manchester , UK"},{"name":"Zurab Khasidashvili","slug":"zurab-khasidashvili","given":"Zurab","family":"Khasidashvili","affiliation":"Intel , Israel"},{"name":"Konstantin Korovin","slug":"konstantin-korovin","given":"Konstantin","family":"Korovin","affiliation":"The University of Manchester , UK"}],"abstract":"Application domains of Bayesian optimization include optimizing black-box functions or very complex functions.\r\nThe functions we are interested in describe complex real-world systems applied in industrial settings.\r\nEven though they do have explicit representations, standard optimization techniques fail to provide validated solutions and correctness guarantees for them.\r\nIn this paper we present a combination of Bayesian optimization and SMT-based constraint solving to achieve safe and stable solutions with optimality guarantees.","doi":"10.24963/ijcai.2022/249","url":"https://ijcai.org/proceedings/2022/249","pdf":"https://ijcai.org/proceedings/2022/0249.pdf","markdown":"https://ijcai.org/proceedings/2022/249.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/249","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Constraint Satisfaction and Optimization","track":"Main Track","number":249,"pages":{"first":1788,"last":1794},"keywords":["Constraint Satisfaction and Optimization: Satisfiabilty","Constraint Satisfaction and Optimization: Constraints and Machine Learning","Machine Learning: Optimisation","Constraint Satisfaction and Optimization: Solvers and Tools","Constraint Satisfaction and Optimization: Constraint Optimization"],"videos":[{"label":"Video #1","url":"https://slideslive.com/38986923","length_sec":93,"provider":"slideslive"},{"label":"Video #2","url":"https://slideslive.com/38985066","length_sec":316,"provider":"slideslive"}],"references":[{"position":1,"raw":"[Beyer and Sendhoff, 2007] Hans-Georg Beyer and Bern- hard Sendhoff. Robust optimization -a comprehensive survey. Computer Methods in Applied Mechanics and En- gineering, 196(33):3190-3218, 2007.","title":"Robust optimization -a comprehensive survey","authors":"Sendhoff Beyer","year":"2007","venue":"Computer Methods in Applied Mechanics and Engineering","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bogunovic et al., 2018] Ilija Bogunovic, Jonathan Scarlett, Stefanie Jegelka, and Volkan Cevher. Adversarially ro- bust optimization with Gaussian processes. In Samy Ben- gio, Hanna M. Wallach, Hugo Larochelle, Kristen Grau- man, Nicolò Cesa-Bianchi, and Roman Garnett, editors, Advances in Neural Information Processing Systems 31: NeurIPS 2018, pages 5765-5775, 2018.","title":"Adversarially robust optimization with Gaussian processes","authors":"Ilija Bogunovic, Jonathan Scarlett, Stefanie Jegelka, Volkan Cevher","year":"2018","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Brauße et al., 2019] Franz Brauße, Konstantin Korovin, Margarita V. Korovina, and Norbert Th. Müller. A CDCL- style calculus for solving non-linear constraints. In An- dreas Herzig and Andrei Popescu, editors, Frontiers of Combining Systems -12th International Symposium, Fro- CoS 2019, London, UK. Proceedings, volume 11715 of LNCS, pages 131-148. Springer, 2019.","title":"A CDCLstyle calculus for solving non-linear constraints","authors":"Franz Brauße, Konstantin Korovin, Margarita V Korovina, Norbert Th, Müller","year":"2019","venue":"Frontiers of Combining Systems -12th International Symposium, Fro-CoS 2019","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brauße et al., 2020] Franz Brauße, Zurab Khasidashvili, and Konstantin Korovin. Selecting stable safe config- urations for systems modelled by neural networks with ReLU activation. In 2020 Formal Methods in Computer Aided Design, FMCAD 2020, Haifa, Israel, pages 119- 127. IEEE, 2020.","title":"Selecting stable safe configurations for systems modelled by neural networks with ReLU activation","authors":"Brauße","year":"2020","venue":"Formal Methods in Computer Aided Design, FMCAD 2020","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brauße et al., 2021] Franz Brauße, Konstantin Korovin, Margarita V. Korovina, and Norbert Th. Müller. The ksmt calculus is a δ-complete decision procedure for non-linear constraints. In André Platzer and Geoff Sutcliffe, edi- tors, Automated Deduction -CADE 28 -28th International Conference on Automated Deduction, Virtual Event, July 12-15, 2021, Proceedings, volume 12699 of LNCS, pages 113-130. Springer, 2021.","title":"The ksmt calculus is a δ-complete decision procedure for non-linear constraints","authors":"Franz Brauße, Konstantin Korovin, Margarita V Korovina, Norbert Th, Müller","year":"2021","venue":"editors, Automated Deduction -CADE 28 -28th International Conference on Automated Deduction, Virtual Event","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cardelli et al., 2019] Luca Cardelli, Marta Kwiatkowska, Luca Laurenti, and Andrea Patane. Robustness guarantees for Bayesian inference with Gaussian processes. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, pages 7759-7768. AAAI Press, 2019.","title":"Robustness guarantees for Bayesian inference with Gaussian processes","authors":"Luca Cardelli, Marta Kwiatkowska, Luca Laurenti, Andrea Patane","year":"2019","venue":"The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Cimatti et al., 2013] Alessandro Cimatti, Alberto Griggio, Bastiaan Joost Schaafsma, and Roberto Sebastiani. The MathSAT5 SMT solver. In Nir Piterman and Scott A. Smolka, editors, Tools and Algorithms for the Construc- tion and Analysis of Systems -19th International Confer- ence, TACAS 2013, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2013. Proceedings, volume 7795 of LNCS, pages 93-107. Springer, 2013.","title":"The MathSAT5 SMT solver","authors":"Alessandro Cimatti, Alberto Griggio, Bastiaan Joost Schaafsma, Roberto Sebastiani","year":"2013","venue":"Tools and Algorithms for the Construction and Analysis of Systems -19th International Conference, TACAS 2013, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2013. Proceedings","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[de Moura and Bjørner, 2008] Leonardo de Moura and Nikolaj Bjørner. Z3: an efficient SMT solver. In C. R. Ramakrishnan and Jakob Rehof, editors, Tools and Algorithms for the Construction and Analysis of Systems, 14th International Conference, TACAS 2008, Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS 2008, Budapest, Hungary. Proceedings, volume 4963 of LNCS, pages 337-340. Springer, 2008.","title":"Leonardo de Moura and Nikolaj Bjørner. Z3: an efficient SMT solver","authors":"De Moura, Bjørner","year":"2008","venue":"Tools and Algorithms for the Construction and Analysis of Systems, 14th International Conference, TACAS 2008, Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS 2008","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Frazier, 2018] Peter I. Frazier. A tutorial on Bayesian opti- mization. CoRR, abs/1807.02811, 2018.","title":"A tutorial on Bayesian optimization","authors":"I Peter, Frazier","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Gao et al., 2012] Sicun Gao, Jeremy Avigad, and Ed- mund M. Clarke. δ-complete decision procedures for satis- fiability over the reals. In Bernhard Gramlich, Dale Miller, and Uli Sattler, editors, Automated Reasoning -6th Inter- national Joint Conference, IJCAR 2012, Proceedings, vol- ume 7364 of LNCS, pages 286-300. Springer, 2012.","title":"δ-complete decision procedures for satisfiability over the reals","authors":"Gao","year":"2012","venue":"Automated Reasoning -6th International Joint Conference, IJCAR 2012, Proceedings","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Gardner et al., 2014] Jacob R. Gardner, Matt J. Kusner, Zhixiang Eddie Xu, Kilian Q. Weinberger, and John P. Cunningham. Bayesian optimization with inequality con- straints. In Proceedings of the 31th International Confer- ence on Machine Learning, ICML 2014, Beijing, China, volume 32 of JMLR Workshop and Conference Proceed- ings, pages 937-945. JMLR.org, 2014.","title":"Bayesian optimization with inequality constraints","authors":"Jacob R Gardner, Matt J Kusner, Eddie Zhixiang, Kilian Q Xu, John P Weinberger, Cunningham","year":"2014","venue":"Proceedings of the 31th International Conference on Machine Learning, ICML 2014","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mockus, 1975] Jonas Mockus. On Bayesian methods for seeking the extremum. Optimization Techniques IFIP Technical Conference, 1975.","title":"On Bayesian methods for seeking the extremum","authors":"Jonas Mockus","year":"1975","venue":"Optimization Techniques IFIP Technical Conference","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Mockus, 1989] Jonas Mockus. Bayesian approach to global optimization: Theory and applications. Kluwer Academic Publishers, 1989.","title":"Bayesian approach to global optimization: Theory and applications","authors":"Jonas Mockus, Mockus","year":"1989","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Pedregosa et al., 2011] Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake VanderPlas, Alexandre Pas- sos, David Cournapeau, Matthieu Brucher, Matthieu Per- rot, and Edouard Duchesnay. Scikit-learn: Machine learn- ing in Python. Journal of Machine Learning Research, 12:2825-2830, 2011.","title":"Scikit-learn: Machine learning in Python","authors":"Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, Edouard Duchesnay","year":"2011","venue":"Journal of Machine Learning Research","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Rasmussen and Williams, 2006] Carl Edward Rasmussen and Christopher K. I. Williams. Gaussian processes for machine learning. The MIT Press, Cambridge, MA, 2006.","title":"Gaussian processes for machine learning","authors":"Carl Edward Rasmussen, Christopher K I Williams","year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sanders et al., 2019] Nicholas D. Sanders, Richard M. Ev- erson, Jonathan E. Fieldsend, and Alma A. M. Ra- hat. A Bayesian approach for the robust optimisation of expensive-to-evaluate functions. IEEE Transactions on Evolutionary Computing. arXiv : 1904.11416v2, pages 2951-2959, 2019.","title":"A Bayesian approach for the robust optimisation of expensive-to-evaluate functions","authors":"Nicholas D Sanders, Richard M Everson, Jonathan E Fieldsend, Alma A M Rahat","year":"2019","venue":"IEEE Transactions on Evolutionary Computing","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Snoek et al., 2012] Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. Practical Bayesian optimization of ma- chine learning algorithms. Advances in Neural Informa- tion Processing Systems, pages 2951-2959, 2012.","title":"Practical Bayesian optimization of machine learning algorithms","authors":"Snoek","year":"2012","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}