{"type":"ScholarlyArticle","title":"Disentanglement of Latent Representations via Causal Interventions","authors":[{"name":"Gaël Gendron","slug":"gael-gendron","given":"Gaël","family":"Gendron","affiliation":"University of Auckland"},{"name":"Michael Witbrock","slug":"michael-witbrock","given":"Michael","family":"Witbrock","affiliation":"University of Auckland"},{"name":"Gillian Dobbie","slug":"gillian-dobbie","given":"Gillian","family":"Dobbie","affiliation":"University of Auckland"}],"abstract":"The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and independent component analysis fields. Recently, approaches merging these domains together have shown great success. Instead of directly representing the factors of variation, the problem of disentanglement can be seen as finding the interventions on one image that yield a change to a single factor. Following this assumption, we introduce a new method for disentanglement inspired by causal dynamics that combines causality theory with vector-quantized variational autoencoders. Our model considers the quantized vectors as causal variables and links them in a causal graph. It performs causal interventions on the graph and generates atomic transitions affecting a unique factor of variation in the image. We also introduce a new task of action retrieval that consists of finding the action responsible for the transition between two images. We test our method on standard synthetic and real-world disentanglement datasets. We show that it can effectively disentangle the factors of variation and perform precise interventions on high-level semantic attributes of an image without affecting its quality, even with imbalanced data distributions.","doi":"10.24963/ijcai.2023/361","url":"https://ijcai.org/proceedings/2023/361","pdf":"https://ijcai.org/proceedings/2023/0361.pdf","markdown":"https://ijcai.org/proceedings/2023/361.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/361","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Knowledge Representation and Reasoning","track":"Main Track","number":361,"pages":{"first":3239,"last":3247},"keywords":["Knowledge Representation and Reasoning: KRR: Causality","Computer Vision: CV: Representation learning","Machine Learning: ML: Autoencoders"],"videos":[],"references":[{"position":1,"raw":"[Ahuja et al., 2022] Kartik Ahuja, Yixin Wang, Divyat Ma- hajan, and Yoshua Bengio. Interventional causal represen- tation learning. CoRR, abs/2209.11924, 2022.","title":"Interventional causal representation learning","authors":"Kartik Ahuja, Yixin Wang, Divyat Mahajan, Yoshua Bengio","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Annadani et al., 2021] Yashas Annadani, Jonas Rothfuss, Alexandre Lacoste, Nino Scherrer, Anirudh Goyal, Yoshua Bengio, and Stefan Bauer. Variational causal net- works: Approximate bayesian inference over causal struc- tures. CoRR, abs/2106.07635, 2021.","title":"Variational causal networks: Approximate bayesian inference over causal structures","authors":"Annadani","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bareinboim et al., 2022] Elias Bareinboim, Juan D Correa, Duligur Ibeling, and Thomas Icard. On pearl's hierarchy and the foundations of causal inference. In Probabilistic and Causal Inference: The Works of Judea Pearl, pages 507-556. 2022.","title":"On pearl's hierarchy and the foundations of causal inference","authors":"Elias Bareinboim, Juan D Correa, Duligur Ibeling, Thomas Icard","year":"2022","venue":"Probabilistic and Causal Inference: The Works of Judea Pearl","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chen et al., 2018] Tian Qi Chen, Xuechen Li, Roger B. Grosse, and David Duvenaud. Isolating sources of dis- entanglement in variational autoencoders. In Samy Ben- gio, Hanna M. Wallach, Hugo Larochelle, Kristen Grau- man, Nicolò Cesa-Bianchi, and Roman Garnett, editors, Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Sys- tems 2018, NeurIPS 2018, December 3-8, 2018, Montréal, Canada, pages 2615-2625, 2018.","title":"Isolating sources of disentanglement in variational autoencoders","authors":"Tian Qi, Chen, Xuechen Li, Roger B Grosse, David Duvenaud","year":"2018","venue":"Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Eastwood and Williams, 2018] Cian Eastwood and Christo- pher K. I. Williams. A framework for the quantitative evaluation of disentangled representations. In 6th Inter- national Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 -May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.","title":"A framework for the quantitative evaluation of disentangled representations","authors":"Cian Eastwood, K I Christopher, Williams","year":"2018","venue":"6th International Conference on Learning Representations, ICLR 2018","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Gabbay et al., 2021] Aviv Gabbay, Niv Cohen, and Yedid Hoshen. An image is worth more than a thousand words: Towards disentanglement in the wild. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, pages 9216-9228, 2021.","title":"An image is worth more than a thousand words: Towards disentanglement in the wild","authors":"Gabbay","year":"2021","venue":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Geffner et al., 2022] Tomas Geffner, Javier Antoran, Adam Foster, Wenbo Gong, Chao Ma, Emre Kiciman, Amit Sharma, Angus Lamb, Martin Kukla, Nick Pawlowski, Miltiadis Allamanis, and Cheng Zhang. Deep end-to-end causal inference. CoRR, abs/2202.02195, 2022.","title":"Deep end-to-end causal inference","authors":"Tomas Geffner, Javier Antoran, Adam Foster, Wenbo Gong, Chao Ma, Emre Kiciman, Amit Sharma, Angus Lamb, Martin Kukla, Nick Pawlowski, Miltiadis Allamanis, Cheng Zhang","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Gresele et al., 2021] Luigi Gresele, Julius von Kügel- gen, Vincent Stimper, Bernhard Schölkopf, and Michel Besserve. Independent mechanism analysis, a new con- cept? In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Pro- cessing Systems 34: Annual Conference on Neural Infor- mation Processing Systems 2021, NeurIPS 2021, Decem- ber 6-14, 2021, virtual, pages 28233-28248, 2021.","title":"Independent mechanism analysis, a new concept?","authors":"Gresele","year":"2021","venue":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hamilton et al., 2017] William L. Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Con- ference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pages 1024- 1034, 2017.","title":"Inductive representation learning on large graphs","authors":"William L Hamilton, Zhitao Ying, Jure Leskovec","year":"2017","venue":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Higgins et al., 2017] Irina Higgins, Loïc Matthey, Arka Pal, Christopher P. Burgess, Xavier Glorot, Matthew M. Botvinick, Shakir Mohamed, and Alexander Lerchner. beta-vae: Learning basic visual concepts with a con- strained variational framework. In 5th International Con- ference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017.","title":"beta-vae: Learning basic visual concepts with a constrained variational framework","authors":"Irina Higgins, Loïc Matthey, Arka Pal, Christopher P Burgess, Xavier Glorot, Matthew M Botvinick, Shakir Mohamed, Alexander Lerchner","year":"2017","venue":"5th International Conference on Learning Representations, ICLR 2017","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Higgins et al., 2018] Irina Higgins, David Amos, David Pfau, Sébastien Racanière, Loïc Matthey, Danilo J. Rezende, and Alexander Lerchner. Towards a definition of disentangled representations. CoRR, abs/1812.02230, 2018.","title":"Towards a definition of disentangled representations","authors":"Irina Higgins, David Amos, David Pfau, Sébastien Racanière, Loïc Matthey, Danilo J Rezende, Alexander Lerchner","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Horan et al., 2021] Daniella Horan, Eitan Richardson, and Yair Weiss. When is unsupervised disentanglement pos- sible? In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan, editors, Advances in Neural Information Pro- cessing Systems 34: Annual Conference on Neural Infor- mation Processing Systems 2021, NeurIPS 2021, Decem- ber 6-14, 2021, virtual, pages 5150-5161, 2021.","title":"When is unsupervised disentanglement possible?","authors":"Daniella Horan, Eitan Richardson, Yair Weiss","year":"2021","venue":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Jang et al., 2017] Eric Jang, Shixiang Gu, and Ben Poole. Categorical reparameterization with gumbel-softmax. In 5th International Conference on Learning Representa- tions, ICLR 2017, Toulon, France, April 24-26, 2017, Con- ference Track Proceedings. OpenReview.net, 2017.","title":"Categorical reparameterization with gumbel-softmax","authors":"Jang","year":"2017","venue":"5th International Conference on Learning Representations, ICLR 2017","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kim and Mnih, 2018] Hyunjik Kim and Andriy Mnih. Dis- entangling by factorising. In Jennifer G. Dy and Andreas Krause, editors, Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stock- holmsmässan, Stockholm, Sweden, July 10-15, 2018, vol- ume 80 of Proceedings of Machine Learning Research, pages 2654-2663. PMLR, 2018.","title":"Disentangling by factorising","authors":"Mnih ; Kim, Hyunjik Kim, Andriy Mnih","year":"2018","venue":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kingma and Welling, 2014] Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. In Yoshua Ben- gio and Yann LeCun, editors, 2nd International Confer- ence on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Conference Track Proceed- ings, 2014.","title":"Auto-encoding variational bayes","authors":"P Diederik, Max Kingma, Welling","year":"2014","venue":"2nd International Conference on Learning Representations, ICLR 2014","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017.","title":"Semi-supervised classification with graph convolutional networks","authors":"Thomas N Kipf, Max Welling","year":"2017","venue":"5th International Conference on Learning Representations, ICLR 2017","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Kumar et al., 2018] Abhishek Kumar, Prasanna Sattigeri, and Avinash Balakrishnan. Variational inference of dis- entangled latent concepts from unlabeled observations. In 6th International Conference on Learning Representa- tions, ICLR 2018, Vancouver, BC, Canada, April 30 -May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.","title":"Variational inference of disentangled latent concepts from unlabeled observations","authors":"Abhishek Kumar, Prasanna Sattigeri, Avinash Balakrishnan","year":"2018","venue":"6th International Conference on Learning Representations, ICLR 2018","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lachapelle et al., 2022] Sébastien Lachapelle, Pau Ro- dríguez, Yash Sharma, Katie Everett, Rémi Le Priol, Alexandre Lacoste, and Simon Lacoste-Julien. Disentan- glement via mechanism sparsity regularization: A new principle for nonlinear ICA. In Bernhard Schölkopf, Car- oline Uhler, and Kun Zhang, editors, 1st Conference on Causal Learning and Reasoning, CLeaR 2022, Sequoia Conference Center, Eureka, CA, USA, 11-13 April, 2022, volume 177 of Proceedings of Machine Learning Re- search, pages 428-484. PMLR, 2022.","title":"Disentanglement via mechanism sparsity regularization: A new principle for nonlinear ICA","authors":"Sébastien Lachapelle, Pau Rodríguez, Yash Sharma, Katie Everett, Rémi Le Priol, Alexandre Lacoste, Simon Lacoste-Julien","year":"2022","venue":"1st Conference on Causal Learning and Reasoning, CLeaR 2022, Sequoia Conference Center","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Lei et al., 2022] Anson Lei, Bernhard Schölkopf, and Ing- mar Posner. Causal discovery for modular world models. In NeurIPS 2022 Workshop on Neuro Causal and Symbolic AI (nCSI), 2022.","title":"Causal discovery for modular world models","authors":"Anson Lei, Bernhard Schölkopf, Ingmar Posner","year":"2022","venue":"NeurIPS 2022 Workshop on Neuro Causal and Symbolic AI (nCSI)","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Liu et al., 2015] Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang. Deep learning face attributes in the wild. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015, pages 3730-3738. IEEE Computer Society, 2015.","title":"Deep learning face attributes in the wild","authors":"Ziwei Liu, Ping Luo, Xiaogang Wang, Xiaoou Tang","year":"2015","venue":"IEEE International Conference on Computer Vision, ICCV 2015","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Locatello et al., 2019] Francesco Locatello, Stefan Bauer, Mario Lucic, Gunnar Rätsch, Sylvain Gelly, Bernhard Schölkopf, and Olivier Bachem. Challenging common assumptions in the unsupervised learning of disentan- gled representations. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th Interna- tional Conference on Machine Learning, ICML 2019, 9- 15 June 2019, Long Beach, California, USA, volume 97 of Proceedings of Machine Learning Research, pages 4114- 4124. PMLR, 2019.","title":"Challenging common assumptions in the unsupervised learning of disentangled representations","authors":"Francesco Locatello, Stefan Bauer, Mario Lucic, Gunnar Rätsch, Sylvain Gelly, Bernhard Schölkopf, Olivier Bachem","year":"2019","venue":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Locatello et al., 2020] Francesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf, Olivier Bachem, and Michael Tschannen. Weakly-supervised disentanglement without compromises. In Proceedings of the 37th Interna- tional Conference on Machine Learning, ICML 2020, 13- 18 July 2020, Virtual Event, volume 119 of Proceedings of Machine Learning Research, pages 6348-6359. PMLR, 2020.","title":"Weakly-supervised disentanglement without compromises","authors":"Francesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf, Olivier Bachem, Michael Tschannen","year":"2020","venue":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Mathieu et al., 2019] Emile Mathieu, Tom Rainforth, N. Siddharth, and Yee Whye Teh. Disentangling dis- entanglement in variational autoencoders. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceed- ings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, volume 97 of Proceedings of Machine Learning Research, pages 4402-4412. PMLR, 2019.","title":"Disentangling disentanglement in variational autoencoders","authors":"Emile Mathieu, Tom Rainforth, N Siddharth, Yee Whye Teh","year":"2019","venue":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Pearl, 2009] Judea Pearl. Causality. Cambridge university press, 2009.","title":"Judea Pearl. Causality","authors":"Pearl","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Ramesh et al., 2021] Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Learning Research, pages 8821-8831. PMLR, 2021.","title":"Zero-shot text-to-image generation","authors":"Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever","year":"2021","venue":"Proceedings of the 38th International Conference on Machine Learning, ICML 2021","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Razavi et al., 2019] Ali Razavi, Aäron van den Oord, and Oriol Vinyals. Generating diverse high-fidelity images with VQ-VAE-2. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Emily B. Fox, and Roman Garnett, editors, Advances in Neural Informa- tion Processing Systems 32: Annual Conference on Neu- ral Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pages 14837-14847, 2019.","title":"Generating diverse high-fidelity images with VQ-VAE-2","authors":"Ali Razavi, Aäron Van Den Oord, Oriol Vinyals","year":"2019","venue":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Reed et al., 2015] Scott E. Reed, Yi Zhang, Yuting Zhang, and Honglak Lee. Deep visual analogy-making. In Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett, editors, Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, pages 1252-1260, 2015.","title":"Deep visual analogy-making","authors":"Scott E Reed, Yi Zhang, Yuting Zhang, Honglak Lee","year":"2015","venue":"Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Sánchez-Martín et al., 2022] Pablo Sánchez-Martín, Miriam Rateike, and Isabel Valera. VACA: designing variational graph autoencoders for causal queries. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artifi- cial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022, pages 8159-8168. AAAI Press, 2022.","title":"VACA: designing variational graph autoencoders for causal queries","authors":"Sánchez-Martín","year":"2022","venue":"Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Schölkopf et al., 2021] Bernhard Schölkopf, Francesco Lo- catello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbren- ner, Anirudh Goyal, and Yoshua Bengio. Toward causal representation learning. Proc. IEEE, 109(5):612-634, 2021.","title":"Toward causal representation learning","authors":"Schölkopf","year":"2021","venue":"Proc. IEEE","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Suter et al., 2019] Raphael Suter, Ðorðe Miladinovic, Bern- hard Schölkopf, and Stefan Bauer. Robustly disentan- gled causal mechanisms: Validating deep representations for interventional robustness. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, vol- ume 97 of Proceedings of Machine Learning Research, pages 6056-6065. PMLR, 2019.","title":"Robustly disentangled causal mechanisms: Validating deep representations for interventional robustness","authors":"Raphael Suter, Ðorðe Miladinovic, Bernhard Schölkopf, Stefan Bauer","year":"2019","venue":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Träuble et al., 2022] Frederik Träuble, Anirudh Goyal, Nasim Rahaman, Michael Mozer, Kenji Kawaguchi, Yoshua Bengio, and Bernhard Schölkopf. Discrete key- value bottleneck. CoRR, abs/2207.11240, 2022.","title":"Discrete keyvalue bottleneck","authors":"Frederik Träuble, Anirudh Goyal, Nasim Rahaman, Michael Mozer, Kenji Kawaguchi, Yoshua Bengio, Bernhard Schölkopf","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[van den Oord et al., 2017] Aäron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. Neural discrete repre- sentation learning. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Con- ference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pages 6306- 6315, 2017.","title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","authors":"Oord Van Den","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Velickovic et al., 2018] Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph attention networks. In 6th Inter- national Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 -May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.","title":"Graph attention networks","authors":"Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, Yoshua Bengio","year":"2018","venue":"6th International Conference on Learning Representations, ICLR 2018","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Williams et al., 2021] Jennifer Williams, Yi Zhao, Erica Cooper, and Junichi Yamagishi. Learning disentangled phone and speaker representations in a semi-supervised VQ-VAE paradigm. In IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2021, Toronto, ON, Canada, June 6-11, 2021, pages 7053-7057. IEEE, 2021.","title":"Learning disentangled phone and speaker representations in a semi-supervised VQ-VAE paradigm","authors":"Jennifer Williams, Yi Zhao, Erica Cooper, Junichi Yamagishi","year":"2021","venue":"IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2021","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Yang et al., 2021] Mengyue Yang, Furui Liu, Zhitang Chen, Xinwei Shen, Jianye Hao, and Jun Wang. Causalvae: Disentangled representation learning via neural structural causal models. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19- 25, 2021, pages 9593-9602. Computer Vision Foundation / IEEE, 2021.","title":"Causalvae: Disentangled representation learning via neural structural causal models","authors":"Yang","year":"2021","venue":"IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Zecevic et al., 2021] Matej Zecevic, Devendra Singh Dhami, Petar Velickovic, and Kristian Kersting. Relating graph neural networks to structural causal models. CoRR, abs/2109.04173, 2021.","title":"Relating graph neural networks to structural causal models","authors":"Matej Zecevic, Devendra Singh Dhami, Petar Velickovic, Kristian Kersting","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}