{"type":"ScholarlyArticle","title":"Temporal Inductive Logic Reasoning over Hypergraphs","authors":[{"name":"Yuan Yang","slug":"yuan-yang","given":"Yuan","family":"Yang","affiliation":"Georgia Institute of Technology"},{"name":"Siheng Xiong","slug":"siheng-xiong","given":"Siheng","family":"Xiong","affiliation":"Georgia Institute of Technology"},{"name":"Ali Payani","slug":"ali-payani","given":"Ali","family":"Payani","affiliation":"Cisco"},{"name":"James C. Kerce","slug":"james-c-kerce","given":"James C.","family":"Kerce","affiliation":"Georgia Institute of Technology"},{"name":"Faramarz Fekri","slug":"faramarz-fekri","given":"Faramarz","family":"Fekri","affiliation":"Georgia Institute of Technology"}],"abstract":"Inductive logic reasoning is a fundamental task in graph analysis, which aims to generalize patterns from data. This task has been extensively studied for traditional graph representations, such as knowledge graphs (KGs), using techniques like inductive logic programming (ILP). Existing ILP methods assume learning from KGs with static facts and binary relations. Beyond KGs, graph structures are widely present in other applications such as procedural instructions, scene graphs, and program executions. While ILP is beneficial for these applications, applying it to those graphs is nontrivial: they are more complex than KGs, which usually involve timestamps and n-ary relations, effectively a type of hypergraph with temporal events. In this work, we propose temporal inductive logic reasoning (TILR), an ILP method that reasons on temporal hypergraphs. To enable hypergraph reasoning, we introduce the multi-start random B-walk, a novel graph traversal method for hypergraphs. By combining it with a path-consistency algorithm, TILR learns logic rules by generalizing from both temporal and relational data. To address the lack of hypergraph benchmarks, we create and release two temporal hypergraph datasets: YouCook2-HG and nuScenes-HG. Experiments on these benchmarks demonstrate that TILR achieves superior reasoning capability over various strong baselines.","doi":"10.24963/ijcai.2024/400","url":"https://ijcai.org/proceedings/2024/400","pdf":"https://ijcai.org/proceedings/2024/0400.pdf","markdown":"https://ijcai.org/proceedings/2024/400.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/400","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Knowledge Representation and Reasoning","track":"Main Track","number":400,"pages":{"first":3613,"last":3621},"keywords":["Data Mining: DM: Knowledge graphs and knowledge base completion","Knowledge Representation and Reasoning: KRR: Logic programming"],"videos":[],"references":[{"position":1,"raw":"[Allen, 1983] James F Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11):832-843, 1983.","title":"Maintaining knowledge about temporal intervals","authors":"James F Allen","year":"1983","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bordes et al., 2013] Antoine Bordes, Nicolas Usunier, Al- berto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In Advances in neural information processing systems, pages 2787-2795, 2013.","title":"Translating embeddings for modeling multi-relational data","authors":"Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, Oksana Yakhnenko","year":"2013","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Boschee et al., 2015] Elizabeth Boschee, Jennifer Lauten- schlager, Sean O'Brien, Steve Shellman, James Starz, and Michael Ward. ICEWS Coded Event Data, 2015.","title":"ICEWS Coded Event Data","authors":"Elizabeth Boschee, Jennifer Lautenschlager, O' Sean, Steve Brien, James Shellman, Michael Starz, Ward","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Caesar et al., 2020] Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. nuscenes: A multimodal dataset for autonomous driving. In CVPR, 2020.","title":"nuscenes: A multimodal dataset for autonomous driving","authors":"Holger Caesar, Varun Bankiti, Alex H Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, Oscar Beijbom","year":"2020","venue":"CVPR","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Campero et al., 2018] Andres Campero, Aldo Pareja, Tim Klinger, Josh Tenenbaum, and Sebastian Riedel. Logical rule induction and theory learning using neural theorem proving. arXiv preprint arXiv:1809.02193, 2018.","title":"Logical rule induction and theory learning using neural theorem proving","authors":"Andres Campero, Aldo Pareja, Tim Klinger, Josh Tenenbaum, Sebastian Riedel","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Carletti et al., 2020] Timoteo Carletti, Federico Battiston, Giulia Cencetti, and Duccio Fanelli. Random walks on hypergraphs. Physical review E, 101(2):022308, 2020.","title":"Random walks on hypergraphs","authors":"Timoteo Carletti, Federico Battiston, Giulia Cencetti, Duccio Fanelli","year":"2020","venue":"Physical review E","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chan et al., 2018] T-H Hubert Chan, Anand Louis, Zhi- hao Gavin Tang, and Chenzi Zhang. Spectral properties of hypergraph laplacian and approximation algorithms. Jour- nal of the ACM (JACM), 65(3):1-48, 2018.","title":"Spectral properties of hypergraph laplacian and approximation algorithms","authors":"T-H Hubert Chan, Anand Louis, Zhihao, Gavin Tang, Chenzi Zhang","year":"2018","venue":"Journal of the ACM (JACM)","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Chitra and Raphael, 2019] Uthsav Chitra and Benjamin Raphael. Random walks on hypergraphs with edge- dependent vertex weights. In International Conference on Machine Learning, pages 1172-1181. PMLR, 2019.","title":"Uthsav Chitra and Benjamin Raphael. Random walks on hypergraphs with edgedependent vertex weights","authors":"Raphael Chitra","year":"2019","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Defferrard et al., 2016] Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. Convolutional neural networks on graphs with fast localized spectral filtering. Advances in neural information processing systems, 29, 2016.","title":"Convolutional neural networks on graphs with fast localized spectral filtering","authors":"Michaël Defferrard, Xavier Bresson, Pierre Vandergheynst","year":"2016","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Evans and Grefenstette, 2018] Richard Evans and Edward Grefenstette. Learning explanatory rules from noisy data. Journal of Artificial Intelligence Research, 61:1-64, 2018.","title":"Learning explanatory rules from noisy data","authors":"Grefenstette Evans, Richard Evans, Edward Grefenstette","year":"2018","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Galárraga et al., 2015] Luis Galárraga, Christina Teflioudi, Katja Hose, and Fabian M Suchanek. Fast rule mining in ontological knowledge bases with amie+. The VLDB Journal-The International Journal on Very Large Data Bases, 24(6):707-730, 2015.","title":"Fast rule mining in ontological knowledge bases with amie+","authors":"Luis Galárraga, Christina Teflioudi, Katja Hose, Fabian M Suchanek","year":"2015","venue":"The VLDB Journal-The International Journal on Very Large Data Bases","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Gallo et al., 1993] Giorgio Gallo, Giustino Longo, Stefano Pallottino, and Sang Nguyen. Directed hypergraphs and applications. Discrete applied mathematics, 42(2-3):177- 201, 1993.","title":"Directed hypergraphs and applications","authors":"Giorgio Gallo, Giustino Longo, Stefano Pallottino, Sang Nguyen","year":"1993","venue":"Discrete applied mathematics","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Hayashi et al., 2020] Koby Hayashi, Sinan G Aksoy, Cheong Hee Park, and Haesun Park. Hypergraph random walks, laplacians, and clustering. In Proceedings of the 29th ACM International Conference on Information & Knowl- edge Management, pages 495-504, 2020.","title":"Hypergraph random walks, laplacians, and clustering","authors":"Koby Hayashi, G Sinan, Cheong Aksoy, Hee Park, Haesun Park","year":"2020","venue":"Proceedings of the 29th ACM International Conference on Information & Knowledge Management","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kipf and Welling, 2016] Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.","title":"Semi-supervised classification with graph convolutional networks","authors":"N Thomas, Max Kipf, Welling","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Lao and Cohen, 2010] Ni Lao and William W Cohen. Re- lational retrieval using a combination of path-constrained random walks. Machine learning, 81(1):53-67, 2010.","title":"Relational retrieval using a combination of path-constrained random walks","authors":"Ni Lao, William W Cohen","year":"2010","venue":"Machine learning","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Lao et al., 2011] Ni Lao, Tom Mitchell, and William Co- hen. Random walk inference and learning in a large scale knowledge base. In Proceedings of the 2011 conference on empirical methods in natural language processing, pages 529-539, 2011.","title":"Random walk inference and learning in a large scale knowledge base","authors":"Ni Lao, Tom Mitchell, William Cohen","year":"2011","venue":"Proceedings of the 2011 conference on empirical methods in natural language processing","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Leetaru and Schrodt, 2013] Kalev Leetaru and Philip A Schrodt. Gdelt: Global data on events, location, and tone, 1979-2012. In ISA annual convention, volume 2, pages 1-49. Citeseer, 2013.","title":"Gdelt: Global data on events, location, and tone, 1979-2012","authors":"Schrodt Leetaru, Kalev Leetaru, Philip A Schrodt","year":"2013","venue":"ISA annual convention","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2020] Pan Li, Niao He, and Olgica Milenkovic. Quadratic decomposable submodular function minimiza- tion: Theory and practice. J. Mach. Learn. Res., 21:106-1, 2020.","title":"Quadratic decomposable submodular function minimization: Theory and practice","authors":"Li","year":"2020","venue":"J. Mach. Learn. Res","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Liu et al., 2022] Yushan Liu, Yunpu Ma, Marcel Hilde- brandt, Mitchell Joblin, and Volker Tresp. Tlogic: Temporal logical rules for explainable link forecasting on temporal knowledge graphs. arXiv preprint arXiv:2112.08025, 2022.","title":"Tlogic: Temporal logical rules for explainable link forecasting on temporal knowledge graphs","authors":"Yushan Liu, Yunpu Ma, Marcel Hildebrandt, Mitchell Joblin, Volker Tresp","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Nguyen et al., 2018] Giang Hoang Nguyen, John Boaz Lee, Ryan A Rossi, Nesreen K Ahmed, Eunyee Koh, and Sungchul Kim. Continuous-time dynamic network em- beddings. In Companion Proceedings of the The Web Con- ference 2018, pages 969-976, 2018.","title":"Continuous-time dynamic network embeddings","authors":"Giang Hoang Nguyen, John Boaz Lee, Ryan A Rossi, Nesreen K Ahmed, Eunyee Koh, Sungchul Kim","year":"2018","venue":"Companion Proceedings of the The Web Conference 2018","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Pareja et al., 2020] Aldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma, Toyotaro Suzumura, Hiroki Kanezashi, Tim Kaler, Tao Schardl, and Charles Leiserson. Evolvegcn: Evolving graph convolutional networks for dynamic graphs. In Proceedings of the AAAI conference on artificial intelli- gence, volume 34, pages 5363-5370, 2020.","title":"Evolvegcn: Evolving graph convolutional networks for dynamic graphs","authors":"Aldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma, Toyotaro Suzumura, Hiroki Kanezashi, Tim Kaler, Tao Schardl, Charles Leiserson","year":"2020","venue":"Proceedings of the AAAI conference on artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Payani and Fekri, 2019] Ali Payani and Faramarz Fekri. In- ductive logic programming via differentiable deep neural logic networks. arXiv preprint arXiv:1906.03523, 2019.","title":"Inductive logic programming via differentiable deep neural logic networks","authors":"Fekri Payani, Ali Payani, Faramarz Fekri","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ronca et al., 2018] Alessandro Ronca, Mark Kaminski, Bernardo Cuenca Grau, Boris Motik, and Ian Horrocks. Stream reasoning in temporal datalog. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.","title":"Stream reasoning in temporal datalog","authors":"Alessandro Ronca, Mark Kaminski, Bernardo Cuenca Grau, Boris Motik, Ian Horrocks","year":"2018","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Sadeghian et al., 2019] Ali Sadeghian, Mohammadreza Ar- mandpour, Patrick Ding, and Daisy Zhe Wang. Drum: End-to-end differentiable rule mining on knowledge graphs. Advances in Neural Information Processing Systems, 32, 2019.","title":"Drum: End-to-end differentiable rule mining on knowledge graphs","authors":"Ali Sadeghian, Mohammadreza Armandpour, Patrick Ding, Daisy Zhe Wang","year":"2019","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Toutanova and Chen, 2015] Kristina Toutanova and Danqi Chen. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositional- ity, pages 57-66, 2015.","title":"Observed versus latent features for knowledge base and text inference","authors":"Chen ; Toutanova, Kristina Toutanova, Danqi Chen","year":"2015","venue":"Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Trivedi et al., 2017] Rakshit Trivedi, Hanjun Dai, Yichen Wang, and Le Song. Know-evolve: Deep temporal rea- soning for dynamic knowledge graphs. In international conference on machine learning, pages 3462-3471. PMLR, 2017.","title":"Know-evolve: Deep temporal reasoning for dynamic knowledge graphs","authors":"Rakshit Trivedi, Hanjun Dai, Yichen Wang, Le Song","year":"2017","venue":"international conference on machine learning","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Xiong et al., 2022] Siheng Xiong, Yuan Yang, Faramarz Fekri, and James Clayton Kerce. Tilp: Differentiable learn- ing of temporal logical rules on knowledge graphs. In The Eleventh International Conference on Learning Represen- tations, 2022.","title":"Tilp: Differentiable learning of temporal logical rules on knowledge graphs","authors":"Xiong","year":"2022","venue":"The Eleventh International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Yang and Song, 2020] Yuan Yang and Le Song. Learn to explain efficiently via neural logic inductive learning. In In- ternational Conference on Learning Representations, 2020.","title":"Learn to explain efficiently via neural logic inductive learning","authors":"Yuan Yang, Le Song","year":"2020","venue":"International Conference on Learning Representations","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Yang et al., 2017] Fan Yang, Zhilin Yang, and William W Cohen. Differentiable learning of logical rules for knowl- edge base reasoning. In Advances in Neural Information Processing Systems, pages 2319-2328, 2017.","title":"Differentiable learning of logical rules for knowledge base reasoning","authors":"Fan Yang, Zhilin Yang, William W Cohen","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Zhou et al., 2018] Luowei Zhou, Chenliang Xu, and Jason J Corso. Towards automatic learning of procedures from web instructional videos. In AAAI Conference on Artificial Intelligence, pages 7590-7598, 2018.","title":"Towards automatic learning of procedures from web instructional videos","authors":"Zhou","year":"2018","venue":"AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}