{"type":"ScholarlyArticle","title":"Building Expressive and Tractable Probabilistic Generative Models: A Review","authors":[{"name":"Sahil Sidheekh","slug":"sahil-sidheekh","given":"Sahil","family":"Sidheekh","affiliation":"The University of Texas at Dallas"},{"name":"Sriraam Natarajan","slug":"sriraam-natarajan","given":"Sriraam","family":"Natarajan","affiliation":"The University of Texas at Dallas"}],"abstract":"We present a comprehensive survey of the advancements  and  techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs, and provide a taxonomy of the field. We also discuss recent efforts to build deep and hybrid PCs by fusing notions from deep neural models, and outline the challenges and open questions that can guide future research in this evolving field.","doi":"10.24963/ijcai.2024/910","url":"https://ijcai.org/proceedings/2024/910","pdf":"https://ijcai.org/proceedings/2024/0910.pdf","markdown":"https://ijcai.org/proceedings/2024/910.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/910","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Survey Track","track":"Survey Track","number":910,"pages":{"first":8234,"last":8243},"keywords":["Machine Learning: ML: Generative models","Uncertainty in AI: UAI: Tractable probabilistic models"],"videos":[],"references":[{"position":1,"raw":"[Adel et al., 2015] Tameem Adel, David Balduzzi, and Ali Ghodsi. Learning the structure of sum-product networks via an svd-based algorithm. In UAI, 2015.","title":"Learning the structure of sum-product networks via an svd-based algorithm","authors":"Tameem Adel, David Balduzzi, Ali Ghodsi","year":"2015","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Ahmed et al., 2022] Kareem Ahmed, Stefano Teso, Kai- Wei Chang, Guy Van den Broeck, and Antonio Vergari. Semantic probabilistic layers for neuro-symbolic learning. NeurIPS, 2022.","title":"Semantic probabilistic layers for neuro-symbolic learning","authors":"Kareem Ahmed, Stefano Teso, Kai-Wei Chang, Guy Van Den, Antonio Broeck, Vergari","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bond-Taylor et al., 2022] S. Bond-Taylor, A. Leach, Y. Long, and C. G. Willcocks. Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models. TPAMI, 2022.","title":"Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models","authors":"S Bond-Taylor, A Leach, Y Long, C G Willcocks","year":"2022","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Butz et al., 2019] Cory J. Butz, Jhonatan de S. Oliveira, André E. dos Santos, and André L. Teixeira. Deep con- volutional sum-product networks. In AAAI, 2019.","title":"Deep convolutional sum-product networks","authors":"Cory J Butz, Jhonatan De, S Oliveira, André E Santos, André L Teixeira","year":"2019","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Choi et al., 2020] YooJung Choi, Antonio Vergari, and Guy Van den Broeck. Probabilistic circuits: A unifying frame- work for tractable probabilistic models. 2020.","title":"Probabilistic circuits: A unifying framework for tractable probabilistic models","authors":"Choi","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Choi et al., 2022] YooJung Choi, Tal Friedman, and Guy Van den Broeck. Solving marginal MAP exactly by probabilistic circuit transformations. In AISTATS, 2022.","title":"Solving marginal MAP exactly by probabilistic circuit transformations","authors":"Choi","year":"2022","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Correia et al., 2023] Alvaro H. C. Correia, Gennaro Gala, Erik Quaeghebeur, Cassio de Campos, and Robert Peharz. Continuous mixtures of tractable probabilistic models. In AAAI, 2023.","title":"Continuous mixtures of tractable probabilistic models","authors":"H C Alvaro, Gennaro Correia, Erik Gala, Cassio Quaeghebeur, Robert De Campos, Peharz","year":"2023","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dang et al., 2020] Meihua Dang, Antonio Vergari, and Guy Broeck. Strudel: Learning structured-decomposable prob- abilistic circuits. In PGM, 2020.","title":"Strudel: Learning structured-decomposable probabilistic circuits","authors":"Dang","year":"2020","venue":"PGM","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Dang et al., 2022] Meihua Dang, Anji Liu, and Guy Van den Broeck. Sparse probabilistic circuits via pruning and growing. In NeurIPS, 2022.","title":"Sparse probabilistic circuits via pruning and growing","authors":"Dang","year":"2022","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Darwiche, 2003] Adnan Darwiche. A differential approach to inference in bayesian networks. J. ACM, (3), 2003.","title":"A differential approach to inference in bayesian networks","authors":"Adnan Darwiche","year":"2003","venue":"J. ACM","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Dempster et al., 1977] Arthur P Dempster, Nan M Laird, and Donald B Rubin. Maximum likelihood from incom- plete data via the em algorithm. Journal of the royal sta- tistical society: series B (methodological), 1977.","title":"Maximum likelihood from incomplete data via the em algorithm","authors":"Nan M Arthur P Dempster, Donald B Laird, Rubin","year":"1977","venue":"Journal of the royal statistical society: series B","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Dennis and Ventura, 2012] Aaron W. Dennis and Dan Ven- tura. Learning the architecture of sum-product networks using clustering on variables. In NeurIPS, 2012.","title":"Learning the architecture of sum-product networks using clustering on variables","authors":"Aaron W Dennis, Dan Ventura","year":"2012","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Di Mauro et al., 2017] Nicola Di Mauro, Antonio Vergari, Teresa MA Basile, and Floriana Esposito. Fast and accu- rate density estimation with extremely randomized cutset networks. In ECML PKDD, 2017.","title":"Fast and accurate density estimation with extremely randomized cutset networks","authors":"Nicola Di, Mauro, Antonio Vergari, Teresa Ma Basile, Floriana Esposito","year":"2017","venue":"ECML PKDD","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Friedman and Koller, 2003] Nir Friedman and Daphne Koller. Being bayesian about network structure. a bayesian approach to structure discovery in bayesian networks. Machine learning, 2003.","title":"Being bayesian about network structure. a bayesian approach to structure discovery in bayesian networks","authors":"Koller Friedman, Nir Friedman, Daphne Koller","year":"2003","venue":"Machine learning","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Friedman, 1998] Nir Friedman. The bayesian structural em algorithm. In UAI, 1998.","title":"The bayesian structural em algorithm","authors":"Nir Friedman","year":"1998","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Gala et al., 2024] Gennaro Gala, Cassio de Campos, Robert Peharz, Antonio Vergari, and Erik Quaeghebeur. Proba- bilistic integral circuits. In AISTATS, 2024.","title":"Probabilistic integral circuits","authors":"Gennaro Gala, Robert Cassio De Campos, Antonio Peharz, Erik Vergari, Quaeghebeur","year":"2024","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Gens and Domingos, 2012] Robert Gens and Pedro M. Domingos. Discriminative learning of sum-product net- works. In NeurIPS, 2012.","title":"Discriminative learning of sum-product networks","authors":"Robert Gens, Pedro M Domingos","year":"2012","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Gens and Domingos, 2013] Robert Gens and Pedro M. Domingos. Learning the structure of sum-product net- works. In ICML, 2013.","title":"Learning the structure of sum-product networks","authors":"Robert Gens, Pedro M Domingos","year":"2013","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ha and Schmidhuber, 2018] David Ha and Jürgen Schmid- huber. Recurrent world models facilitate policy evolution. In NeurIPS, 2018.","title":"Recurrent world models facilitate policy evolution","authors":"Schmidhuber Ha, David Ha, Jürgen Schmidhuber","year":"2018","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In CVPR, 2016.","title":"Deep residual learning for image recognition","authors":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun","year":"2016","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[He et al., 2022] Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross B. Girshick. Masked autoencoders are scalable vision learners. In CVPR, 2022.","title":"Masked autoencoders are scalable vision learners","authors":"Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross B Girshick","year":"2022","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Heckerman et al., 1995] David Heckerman, Dan Geiger, and David M Chickering. Learning bayesian networks: The combination of knowledge and statistical data. Ma- chine learning, 1995.","title":"Learning bayesian networks: The combination of knowledge and statistical data","authors":"David Heckerman, Dan Geiger, David M Chickering","year":"1995","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Karanam et al., 2024] Athresh Karanam, Saurabh Mathur, Sahil Sidheekh, and Sriraam Natarajan. A unified frame- work for human-allied learning of probabilistic circuits. arXiv preprint, 2024.","title":"A unified framework for human-allied learning of probabilistic circuits","authors":"Karanam","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Khosravi et al., 2019] Pasha Khosravi, YooJung Choi, Yi- tao Liang, Antonio Vergari, and Guy Van den Broeck. On tractable computation of expected predictions. In NeurIPS, 2019.","title":"On tractable computation of expected predictions","authors":"Pasha Khosravi, Yoojung Choi, Yitao Liang, Antonio Vergari, Guy Van Den Broeck","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Kisa et al., 2014] Doga Kisa, Guy Van den Broeck, Arthur Choi, and Adnan Darwiche. Probabilistic sentential deci- sion diagrams. In KR, 2014.","title":"Probabilistic sentential decision diagrams","authors":"Kisa","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Koller and Friedman, 2009] Daphne Koller and Nir Fried- man. Probabilistic graphical models: principles and tech- niques. MIT press, 2009.","title":"Probabilistic graphical models: principles and techniques","authors":"Friedman Koller","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Lang et al., 2022] Steven Lang, Martin Mundt, Fabrizio Ventola, Robert Peharz, and Kristian Kersting. Elevat- ing perceptual sample quality in pcs through differentiable sampling. In NeurIPS 2021 Workshop on Pre-registration in Machine Learning, 2022.","title":"Elevating perceptual sample quality in pcs through differentiable sampling","authors":"Steven Lang, Martin Mundt, Fabrizio Ventola, Robert Peharz, Kristian Kersting","year":"2022","venue":"NeurIPS 2021 Workshop on Pre-registration in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Li and Oliva, 2021] Yang Li and Junier Oliva. Active fea- ture acquisition with generative surrogate models. In Ma- rina Meila and Tong Zhang, editors, ICML, 2021.","title":"Active feature acquisition with generative surrogate models","authors":"Oliva ; ] Li, Li Yang, Junier Oliva","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Lindsay, 1995] Bruce G Lindsay. Mixture models: theory, geometry, and applications. Ims, 1995.","title":"Mixture models: theory, geometry, and applications","authors":"G Bruce, Lindsay","year":"1995","venue":"Ims","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Liu et al., 2022] Anji Liu, Stephan Mandt, and Guy Van den Broeck. Lossless compression with probabilistic circuits. In ICLR, 2022.","title":"Lossless compression with probabilistic circuits","authors":"Anji Liu, Stephan Mandt, Guy Van Den Broeck","year":"2022","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Liu et al., 2023a] Anji Liu, Honghua Zhang, and Guy Van den Broeck. Scaling up probabilistic circuits by latent vari- able distillation. In ICLR, 2023.","title":"Scaling up probabilistic circuits by latent variable distillation","authors":"Liu","year":"2023","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Liu et al., 2023b] Xuejie Liu, Anji Liu, Guy Van den Broeck, and Yitao Liang. Understanding the distillation process from deep generative models to tractable proba- bilistic circuits. In ICML, 2023.","title":"Understanding the distillation process from deep generative models to tractable probabilistic circuits","authors":"Liu","year":"2023","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Liu et al., 2024] Anji Liu, Mathias Niepert, and Guy Van den Broeck. Image inpainting via tractable steering of dif- fusion models. In ICLR, 2024.","title":"Image inpainting via tractable steering of diffusion models","authors":"Anji Liu, Mathias Niepert, Guy Van Den Broeck","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Loconte et al., 2024] Lorenzo Loconte, Aleksanteri Miku- lus Sladek, Stefan Mengel, Martin Trapp, Arno Solin, Nicolas Gillis, and Antonio Vergari. Subtractive mix- ture models via squaring: Representation and learning. In ICLR, 2024.","title":"Subtractive mixture models via squaring: Representation and learning","authors":"Lorenzo Loconte, Aleksanteri Mikulus Sladek, Stefan Mengel, Martin Trapp, Arno Solin, Nicolas Gillis, Antonio Vergari","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Mari et al., 2023] Antonio Mari, Gennaro Vessio, and An- tonio Vergari. Unifying and understanding overparameter- ized circuit representations via low-rank tensor decompo- sitions. In The 6th Workshop on Tractable Probabilistic Modeling, 2023.","title":"Antonio Mari, Gennaro Vessio, and Antonio Vergari. Unifying and understanding overparameterized circuit representations via low-rank tensor decompositions","authors":"Mari","year":"2023","venue":"The 6th Workshop on Tractable Probabilistic Modeling","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Marinescu and Dechter, 2005] Radu Marinescu and Rina Dechter. And/or branch-and-bound for graphical models. In IJCAI, 2005.","title":"And/or branch-and-bound for graphical models","authors":"Radu Marinescu, Rina Dechter","year":"2005","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2005/206"},{"position":37,"raw":"[Mathur et al., 2023] Saurabh Mathur, Vibhav Gogate, and Sriraam Natarajan. Knowledge intensive learning of cutset networks. In UAI, 2023.","title":"Knowledge intensive learning of cutset networks","authors":"Saurabh Mathur, Vibhav Gogate, Sriraam Natarajan","year":"2023","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Mauá et al., 2017] Denis D Mauá, Fabio G Cozman, Diar- maid Conaty, and Cassio P Campos. Credal sum-product networks. In ISIPTA, 2017.","title":"Credal sum-product networks","authors":"Fabio G Denis D Mauá, Diarmaid Cozman, Cassio P Conaty, Campos","year":"2017","venue":"ISIPTA","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Mauá et al., 2018] Denis Deratani Mauá, Diarmaid Conaty, Fabio Gagliardi Cozman, Katja Poppenhaeger, and Cas- sio Polpo de Campos. Robustifying sum-product net- works. IJAR, 2018.","title":"Robustifying sum-product networks","authors":"Denis Deratani Mauá, Diarmaid Conaty, Fabio Gagliardi Cozman, Katja Poppenhaeger, Cassio Polpo De Campos","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Mauro et al., 2021] Nicola Di Mauro, Gennaro Gala, Marco Iannotta, and Teresa M. A. Basile. Random probabilistic circuits. In UAI, 2021.","title":"Random probabilistic circuits","authors":"Nicola Di, Mauro, Gennaro Gala, Marco Iannotta, Teresa M A Basile","year":"2021","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Molina et al., 2018] Alejandro Molina, Antonio Vergari, Nicola Di Mauro, Sriraam Natarajan, Floriana Esposito, and Kristian Kersting. Mixed sum-product networks: A deep architecture for hybrid domains. In AAAI, 2018.","title":"Mixed sum-product networks: A deep architecture for hybrid domains","authors":"Alejandro Molina, Antonio Vergari, Nicola Di Mauro, Sriraam Natarajan, Floriana Esposito, Kristian Kersting","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Papez et al., 2024] Milan Papez, Martin Rektoris, Vaclav Smidl, and Tomáš Pevný. Sum-product-set networks: Deep tractable models for tree-structured graphs. In ICLR, 2024.","title":"Sum-product-set networks: Deep tractable models for tree-structured graphs","authors":"Papez","year":"2024","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Peddi et al., 2022] Rohith Peddi, Tahrima Rahman, and Vibhav Gogate. Robust learning of tractable probabilis- tic models. In UAI, 2022.","title":"Robust learning of tractable probabilistic models","authors":"Rohith Peddi, Tahrima Rahman, Vibhav Gogate","year":"2022","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Peharz et al., 2013] Robert Peharz, Bernhard C Geiger, and Franz Pernkopf. Greedy part-wise learning of sum-product networks. In ECML PKDD, 2013.","title":"Greedy part-wise learning of sum-product networks","authors":"Robert Peharz, Bernhard C Geiger, Franz Pernkopf","year":"2013","venue":"ECML PKDD","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Peharz et al., 2014] Robert Peharz, Robert Gens, and Pedro Domingos. Learning selective sum-product networks. In LTPM workshop, ICML, 2014.","title":"Learning selective sum-product networks","authors":"Robert Peharz, Robert Gens, Pedro Domingos","year":"2014","venue":"LTPM workshop","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Peharz et al., 2016] Robert Peharz, Robert Gens, Franz Pernkopf, and Pedro Domingos. On the latent variable interpretation in sum-product networks. TPAMI, 2016.","title":"On the latent variable interpretation in sum-product networks","authors":"Robert Peharz, Robert Gens, Franz Pernkopf, Pedro Domingos","year":"2016","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Peharz et al., 2020a] Robert Peharz, Steven Lang, Antonio Vergari, Karl Stelzner, Alejandro Molina, Martin Trapp, Guy Van den Broeck, Kristian Kersting, and Zoubin Ghahramani. Einsum networks: Fast and scalable learn- ing of tractable probabilistic circuits. In ICML, 2020.","title":"Einsum networks: Fast and scalable learning of tractable probabilistic circuits","authors":"Peharz","year":"2020","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Peharz et al., 2020b] Robert Peharz, Antonio Vergari, Karl Stelzner, Alejandro Molina, Xiaoting Shao, Martin Trapp, Kristian Kersting, and Zoubin Ghahramani. Random sum- product networks: A simple and effective approach to probabilistic deep learning. In UAI, 2020.","title":"Random sumproduct networks: A simple and effective approach to probabilistic deep learning","authors":"Peharz","year":"2020","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Pevný et al., 2020] Tomáš Pevný, Václav Smídl, Martin Trapp, Ondřej Poláček, and Tomáš Oberhuber. Sum- product-transform networks: Exploiting symmetries using invertible transformations. In PGM, 2020.","title":"Sumproduct-transform networks: Exploiting symmetries using invertible transformations","authors":"Pevný","year":"2020","venue":"PGM","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Poon and Domingos, 2011] Hoifung Poon and Pedro M. Domingos. Sum-product networks: A new deep architec- ture. In UAI, 2011.","title":"Sum-product networks: A new deep architecture","authors":"Domingos Poon, Hoifung Poon, Pedro M Domingos","year":"2011","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Rahman et al., 2014] Tahrima Rahman, Prasanna Kothalkar, and Vibhav Gogate. Cutset networks: A simple, tractable, and scalable approach for improving the accuracy of chow-liu trees. In ECML PKDD, 2014.","title":"Cutset networks: A simple, tractable, and scalable approach for improving the accuracy of chow-liu trees","authors":"Rahman","year":"2014","venue":"ECML PKDD","doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Rooshenas and Lowd, 2014] Amirmohammad Rooshenas and Daniel Lowd. Learning sum-product networks with direct and indirect variable interactions. In ICML, 2014.","title":"Amirmohammad Rooshenas and Daniel Lowd. Learning sum-product networks with direct and indirect variable interactions","authors":"Lowd Rooshenas","year":"2014","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Russell, 2010] Stuart J Russell. Artificial intelligence a modern approach. 2010.","title":"Artificial intelligence a modern approach","authors":"Russell Stuart","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Sánchez-Cauce et al., 2021] Raquel Sánchez-Cauce, Iago París, and Francisco Javier Díez. Sum-product networks: A survey. TPAMI, 2021.","title":"Sum-product networks: A survey","authors":"Raquel Sánchez-Cauce, Iago París, Francisco Javier, Díez","year":"2021","venue":"TPAMI","doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Selvam et al., 2023] Nikil Roashan Selvam, Guy Van den Broeck, and YooJung Choi. Certifying fairness of prob- abilistic circuits. In AAAI, 2023.","title":"Certifying fairness of probabilistic circuits","authors":"Guy Nikil Roashan Selvam, Van Den, Yoojung Broeck, Choi","year":"2023","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Shao et al., 2022] Xiaoting Shao, Alejandro Molina, Anto- nio Vergari, Karl Stelzner, Robert Peharz, Thomas Liebig, and Kristian Kersting. Conditional sum-product networks: Modular probabilistic circuits via gate functions. IJAR, 2022.","title":"Conditional sum-product networks: Modular probabilistic circuits via gate functions","authors":"Xiaoting Shao, Alejandro Molina, Antonio Vergari, Karl Stelzner, Robert Peharz, Thomas Liebig, Kristian Kersting","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":57,"raw":"[Sharir and Shashua, 2018] Or Sharir and Amnon Shashua. Sum-product-quotient networks. In AISTATS, 2018.","title":"Or Sharir and Amnon Shashua. Sum-product-quotient networks","authors":"Shashua Sharir","year":"2018","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":58,"raw":"[Shih and Ermon, 2020] Andy Shih and Stefano Ermon. Probabilistic circuits for variational inference in discrete graphical models. In NeurIPS, 2020.","title":"Probabilistic circuits for variational inference in discrete graphical models","authors":"Andy Shih, Stefano Ermon","year":"2020","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":59,"raw":"[Shih et al., 2021] Andy Shih, Dorsa Sadigh, and Stefano Er- mon. Hyperspns: Compact and expressive probabilistic circuits. In NeurIPS, 2021.","title":"Hyperspns: Compact and expressive probabilistic circuits","authors":"Andy Shih, Dorsa Sadigh, Stefano Ermon","year":"2021","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":60,"raw":"[Sidheekh et al., 2023] Sahil Sidheekh, Kristian Kersting, and Sriraam Natarajan. Probabilistic flow circuits: To- wards unified deep models for tractable probabilistic in- ference. In UAI, 2023.","title":"Probabilistic flow circuits: Towards unified deep models for tractable probabilistic inference","authors":"Sahil Sidheekh, Kristian Kersting, Sriraam Natarajan","year":"2023","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":61,"raw":"[Tan and Peharz, 2019] Ping Liang Tan and Robert Peharz. Hierarchical decompositional mixtures of variational au- toencoders. In Kamalika Chaudhuri and Ruslan Salakhut- dinov, editors, ICML, 2019.","title":"Hierarchical decompositional mixtures of variational autoencoders","authors":"Ping Liang, Tan, Robert Peharz","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":62,"raw":"[Trapp et al., 2019] Martin Trapp, Robert Peharz, Hong Ge, Franz Pernkopf, and Zoubin Ghahramani. Bayesian learn- ing of sum-product networks. In NeurIPS, 2019.","title":"Bayesian learning of sum-product networks","authors":"Trapp","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":63,"raw":"[Trapp et al., 2020] Martin Trapp, Robert Peharz, Franz Pernkopf, and Carl Edward Rasmussen. Deep structured mixtures of gaussian processes. In AISTATS, 2020.","title":"Deep structured mixtures of gaussian processes","authors":"Martin Trapp, Robert Peharz, Franz Pernkopf, Carl Edward Rasmussen","year":"2020","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":64,"raw":"[Ventola et al., 2020] Fabrizio Ventola, Karl Stelzner, Ale- jandro Molina, and Kristian Kersting. Residual sum- product networks. In PGM, 2020.","title":"Residual sumproduct networks","authors":"Fabrizio Ventola, Karl Stelzner, Alejandro Molina, Kristian Kersting","year":"2020","venue":"PGM","doi":null,"url":null,"internal_url":null},{"position":65,"raw":"[Ventola et al., 2023] Fabrizio Ventola, Steven Braun, Zhongjie Yu, Martin Mundt, and Kristian Kersting. Probabilistic circuits that know what they don't know. In UAI, 2023.","title":"Probabilistic circuits that know what they don't know","authors":"Fabrizio Ventola, Steven Braun, Zhongjie Yu, Martin Mundt, Kristian Kersting","year":"2023","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":66,"raw":"[Vergari et al., 2018] Antonio Vergari, Robert Peharz, Nicola Di Mauro, Alejandro Molina, Kristian Kersting, and Floriana Esposito. Sum-product autoencoding: En- coding and decoding representations using sum-product networks. In AAAI, 2018.","title":"Sum-product autoencoding: Encoding and decoding representations using sum-product networks","authors":"Vergari","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":67,"raw":"[Vergari et al., 2019] Antonio Vergari, Nicola Di Mauro, and Floriana Esposito. Visualizing and understanding sum- product networks. Machine Learning, 2019.","title":"Visualizing and understanding sumproduct networks","authors":"Vergari","year":"2019","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":68,"raw":"[Vergari et al., 2021] Antonio Vergari, YooJung Choi, Anji Liu, Stefano Teso, and Guy Van den Broeck. A composi- tional atlas of tractable circuit operations for probabilistic inference. In NeurIPS, 2021.","title":"A compositional atlas of tractable circuit operations for probabilistic inference","authors":"Vergari","year":"2021","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":69,"raw":"[Wang and Kwiatkowska, 2023] Benjie Wang and Marta Kwiatkowska. Compositional probabilistic and causal in- ference using tractable circuit models. In AISTATS, 2023.","title":"Compositional probabilistic and causal inference using tractable circuit models","authors":"Wang, Kwiatkowska, Benjie Wang, Marta Kwiatkowska","year":"2023","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":70,"raw":"[Yang et al., 2023] Yang Yang, Gennaro Gala, and Robert Peharz. Bayesian structure scores for probabilistic circuits. In AISTATS, 2023.","title":"Bayesian structure scores for probabilistic circuits","authors":"Yang Yang, Gennaro Gala, Robert Peharz","year":"2023","venue":"AISTATS","doi":null,"url":null,"internal_url":null},{"position":71,"raw":"[Yu et al., 2021] Zhongjie Yu, Mingye Zhu, Martin Trapp, Arseny Skryagin, and Kristian Kersting. Leveraging prob- abilistic circuits for nonparametric multi-output regres- sion. In UAI, 2021.","title":"Leveraging probabilistic circuits for nonparametric multi-output regression","authors":"Zhongjie Yu, Mingye Zhu, Martin Trapp, Arseny Skryagin, Kristian Kersting","year":"2021","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":72,"raw":"[Yu et al., 2022a] Zhongjie Yu, Devendra Singh Dhami, and Kristian Kersting. Sum-product-attention networks: Leveraging self-attention in energy-based probabilistic cir- cuits. In The 5th Workshop on Tractable Probabilistic Modeling, 2022.","title":"Sum-product-attention networks: Leveraging self-attention in energy-based probabilistic circuits","authors":"Yu","year":"2022","venue":"The 5th Workshop on Tractable Probabilistic Modeling","doi":null,"url":null,"internal_url":null},{"position":73,"raw":"[Yu et al., 2022b] Zhongjie Yu, Fabrizio Ventola, Nils Thoma, Devendra Singh Dhami, Martin Mundt, and Kris- tian Kersting. Predictive whittle networks for time series. In UAI, 2022.","title":"Predictive whittle networks for time series","authors":"Yu","year":"2022","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":74,"raw":"[Yu et al., 2024] Zhongjie Yu, Martin Trapp, and Kristian Kersting. Characteristic circuits. In NeurIPS, 2024.","title":"Characteristic circuits","authors":"Zhongjie Yu, Martin Trapp, Kristian Kersting","year":"2024","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":75,"raw":"[Zhang et al., 2023] Honghua Zhang, Meihua Dang, Nanyun Peng, and Guy Van den Broeck. Tractable control for au- toregressive language generation. In ICML, 2023.","title":"Tractable control for autoregressive language generation","authors":"Honghua Zhang, Meihua Dang, Nanyun Peng, Guy Van Den Broeck","year":"2023","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":76,"raw":"[Zhao et al., 2016] Han Zhao, Pascal Poupart, and Geof- frey J Gordon. A unified approach for learning the pa- rameters of sum-product networks. NeurIPS, 2016.","title":"A unified approach for learning the parameters of sum-product networks","authors":"Han Zhao, Pascal Poupart, Geoffrey J Gordon","year":"2016","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":77,"raw":"[Zuidberg Dos Martires, 2024] Pedro Zuidberg Dos Mar- tires. Probabilistic neural circuits. In AAAI, 2024.","title":"Pedro Zuidberg Dos Martires. Probabilistic neural circuits","authors":"Zuidberg Dos, Martires","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}