Robustness Guarantees for Credal Bayesian Networks via Constraint Relaxation over Probabilistic Circuits
Robustness Guarantees for Credal Bayesian Networks via Constraint Relaxation over Probabilistic Circuits
Hjalmar Wijk, Benjie Wang, Marta Kwiatkowska
Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence
Main Track. Pages 4885-4892.
https://doi.org/10.24963/ijcai.2022/677
In many domains, worst-case guarantees on the performance (e.g. prediction accuracy) of a decision function subject to distributional shifts and uncertainty about the environment are crucial. In this work we develop a method to quantify the robustness of decision functions with respect to credal Bayesian networks, formal parametric models of the environment where uncertainty is expressed through credal sets on the parameters. In particular, we address the maximum marginal probability (MARmax) problem, that is, determining the greatest probability of an event (such as misclassification) obtainable for parameters in the credal set. We develop a method to faithfully transfer the problem into a constrained optimization problem on a probabilistic circuit. By performing a simple constraint relaxation, we show how to obtain a guaranteed upper bound on MARmax in linear time in the size of the circuit. We further theoretically characterize this constraint relaxation in terms of the original Bayesian network structure, which yields insight into the tightness of the bound. We implement the method and provide experimental evidence that the upper bound is often near tight and demonstrates improved scalability compared to other methods.
Keywords:
Uncertainty in AI: Bayesian Networks
Agent-based and Multi-agent Systems: Formal Verification, Validation and Synthesis
AI Ethics, Trust, Fairness: Safety & Robustness
Constraint Satisfaction and Optimization: Constraint Satisfaction
Uncertainty in AI: Tractable Probabilistic Models