{"type":"ScholarlyArticle","title":"Fast and Continual Knowledge Graph Embedding via Incremental LoRA","authors":[{"name":"Jiajun Liu","slug":"jiajun-liu","given":"Jiajun","family":"Liu","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Wenjun Ke","slug":"wenjun-ke","given":"Wenjun","family":"Ke","affiliation":"School of Computer Science and Engineering , Southeast University; Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University) , Ministry of Education"},{"name":"Peng Wang","slug":"peng-wang","given":"Peng","family":"Wang","affiliation":"School of Computer Science and Engineering , Southeast University; Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University) , Ministry of Education"},{"name":"Jiahao Wang","slug":"jiahao-wang","given":"Jiahao","family":"Wang","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Jinhua Gao","slug":"jinhua-gao","given":"Jinhua","family":"Gao","affiliation":"Institute of Computing Technology , Chinese Academy of Sciences"},{"name":"Ziyu Shang","slug":"ziyu-shang","given":"Ziyu","family":"Shang","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Guozheng Li","slug":"guozheng-li","given":"Guozheng","family":"Li","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Zijie Xu","slug":"zijie-xu","given":"Zijie","family":"Xu","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Ke Ji","slug":"ke-ji","given":"Ke","family":"Ji","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Yining Li","slug":"yining-li","given":"Yining","family":"Li","affiliation":"College of Software Engineering , Southeast University {jiajliu ,"}],"abstract":"Continual Knowledge Graph Embedding (CKGE) aims to efficiently learn new knowledge and simultaneously preserve old knowledge. Dominant approaches primarily focus on alleviating catastrophic forgetting of old knowledge but neglect efficient learning for the emergence of new knowledge. However, in real-world scenarios, knowledge graphs (KGs) are continuously growing, which brings a significant challenge to fine-tuning KGE models efficiently. To address this issue, we propose a fast CKGE framework (FastKGE), incorporating an incremental low-rank adapter (IncLoRA) mechanism to efficiently acquire new knowledge while preserving old knowledge. Specifically, to mitigate catastrophic forgetting, FastKGE isolates and allocates new knowledge to specific layers based on the fine-grained influence between old and new KGs. Subsequently, to accelerate fine-tuning, FastKGE devises an efficient IncLoRA mechanism, which embeds the specific layers into incremental low-rank adapters with fewer training parameters. Moreover, IncLoRA introduces adaptive rank allocation, which makes the LoRA aware of the importance of entities and adjusts its rank scale adaptively. We conduct experiments on four public datasets and two new datasets with a larger initial scale. Experimental results demonstrate that FastKGE can reduce training time by 34%-49% while still achieving competitive link prediction performance against state-of-the-art models on four public datasets (average MRR score of 21.0% vs. 21.1%). Meanwhile, on two newly constructed datasets, FastKGE saves 51%-68% training time and improves link prediction performance by 1.5%.","doi":"10.24963/ijcai.2024/243","url":"https://ijcai.org/proceedings/2024/243","pdf":"https://ijcai.org/proceedings/2024/0243.pdf","markdown":"https://ijcai.org/proceedings/2024/243.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/243","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Data Mining","track":"Main Track","number":243,"pages":{"first":2198,"last":2206},"keywords":["Data Mining: DM: Knowledge graphs and knowledge base completion"],"videos":[],"references":[{"position":1,"raw":"[Ansuini et al., 2019] Alessio Ansuini, Alessandro Laio, Jakob H Macke, and Davide Zoccolan. Intrinsic dimen- sion of data representations in deep neural networks. In NeurIPS, 2019.","title":"Intrinsic dimension of data representations in deep neural networks","authors":"Alessio Ansuini, Alessandro Laio, Jakob H Macke, Davide Zoccolan","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bordes et al., 2013] Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In NIPS, 2013.","title":"Translating embeddings for modeling multi-relational data","authors":"Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, Oksana Yakhnenko","year":"2013","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bordes et al., 2014] Antoine Bordes, Jason Weston, and Nicolas Usunier. Open question answering with weakly supervised embedding models. In ECML-PKDD, 2014.","title":"Open question answering with weakly supervised embedding models","authors":"Antoine Bordes, Jason Weston, Nicolas Usunier","year":"2014","venue":"ECML-PKDD","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brown et al., 2020] Tom Brown, Benjamin Mann, Nick Ry- der, Melanie Subbiah, Jared D Kaplan, Prafulla Dhari- wal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. In NeurlPS, 2020.","title":"Language models are few-shot learners","authors":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell","year":"2020","venue":"NeurlPS","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Chen et al., 2023] Mingyang Chen, Wen Zhang, Zhen Yao, Yushan Zhu, Yang Gao, Jeff Z Pan, and Huajun Chen. Entity-agnostic representation learning for parameter- efficient knowledge graph embedding. In AAAI, 2023.","title":"Entity-agnostic representation learning for parameterefficient knowledge graph embedding","authors":"Mingyang Chen, Wen Zhang, Zhen Yao, Yushan Zhu, Yang Gao, Jeff Z Pan, Huajun Chen","year":"2023","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Cui et al., 2023] Yuanning Cui, Yuxin Wang, Zequn Sun, Wenqiang Liu, Yiqiao Jiang, Kexin Han, and Wei Hu. Lifelong embedding learning and transfer for growing knowledge graphs. In AAAI, 2023.","title":"Lifelong embedding learning and transfer for growing knowledge graphs","authors":"Cui","year":"2023","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Daruna et al., 2021] Angel Daruna, Mehul Gupta, Mohan Sridharan, and Sonia Chernova. Continual learning of knowledge graph embeddings. IEEE Robotics and Au- tomation Letters, 6(2):1128-1135, 2021.","title":"Continual learning of knowledge graph embeddings","authors":"Angel Daruna, Mehul Gupta, Mohan Sridharan, Sonia Chernova","year":"2021","venue":"IEEE Robotics and Automation Letters","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Dettmers et al., 2018] Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. Convolutional 2d knowledge graph embeddings. In AAAI, 2018.","title":"Convolutional 2d knowledge graph embeddings","authors":"Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Dong et al., 2014] Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, and Wei Zhang. Knowledge vault: A web-scale approach to probabilistic knowledge fusion. In SIGKDD, 2014.","title":"Knowledge vault: A web-scale approach to probabilistic knowledge fusion","authors":"Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, Wei Zhang","year":"2014","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Hamaguchi et al., 2017] Takuo Hamaguchi, Hidekazu Oiwa, Masashi Shimbo, and Yuji Matsumoto. Knowledge transfer for out-of-knowledge-base entities: a graph neural network approach. In IJCAI, 2017.","title":"Knowledge transfer for out-of-knowledge-base entities: a graph neural network approach","authors":"Takuo Hamaguchi, Hidekazu Oiwa, Masashi Shimbo, Yuji Matsumoto","year":"2017","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/250"},{"position":11,"raw":"[Hu et al., 2022] Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. LoRA: Low-rank adaptation of large language models. In ICLR, 2022.","title":"LoRA: Low-rank adaptation of large language models","authors":"J Edward, Yelong Hu, Phillip Shen, Zeyuan Wallis, Yuanzhi Allen-Zhu, Shean Li, Lu Wang, Weizhu Wang, Chen","year":"2022","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kazemi and Poole, 2018] Seyed Mehran Kazemi and David Poole. Simple embedding for link prediction in knowledge graphs. In NeurIPS, 2018.","title":"Simple embedding for link prediction in knowledge graphs","authors":"Seyed Mehran, Kazemi, David Poole","year":"2018","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kirkpatrick et al., 2017] James Kirkpatrick, Razvan Pas- canu, Neil Rabinowitz, Joel Veness, Guillaume Des- jardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. Overcom- ing catastrophic forgetting in neural networks. Proceed- ings of the national academy of sciences, 114(13):3521- 3526, 2017.","title":"Overcoming catastrophic forgetting in neural networks","authors":"Kirkpatrick","year":"2017","venue":"Proceedings of the national academy of sciences","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Kou et al., 2020] Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou, and Yan Zhang. Disentangle-based con- tinual graph representation learning. In EMNLP, 2020.","title":"Disentangle-based continual graph representation learning","authors":"Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou, Yan Zhang","year":"2020","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Li et al., 2022] Guozheng Li, Xu Chen, Peng Wang, Jiafeng Xie, and Qiqing Luo. Fastre: Towards fast relation ex- traction with convolutional encoder and improved cascade binary tagging framework. In IJCAI, 2022.","title":"Fastre: Towards fast relation extraction with convolutional encoder and improved cascade binary tagging framework","authors":"Guozheng Li, Xu Chen, Peng Wang, Jiafeng Xie, Qiqing Luo","year":"2022","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2022/583"},{"position":16,"raw":"[Li et al., 2024] Guozheng Li, Wenjun Ke, Peng Wang, Zi- jie Xu, Ke Ji, Jiajun Liu, Ziyu Shang, and Qiqing Luo. Unlocking instructive in-context learning with tabular prompting for relational triple extraction. arXiv preprint arXiv:2402.13741, 2024.","title":"Unlocking instructive in-context learning with tabular prompting for relational triple extraction","authors":"Guozheng Li, Wenjun Ke, Peng Wang, Zijie Xu, Ke Ji, Jiajun Liu, Ziyu Shang, Qiqing Luo","year":"2024","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liu et al., 2020] Yuzhang Liu, Peng Wang, Yingtai Li, Yizhan Shao, and Zhongkai Xu. Aprile: Attention with pseudo residual connection for knowledge graph embed- ding. In COLING, 2020.","title":"Aprile: Attention with pseudo residual connection for knowledge graph embedding","authors":"Yuzhang Liu, Peng Wang, Yingtai Li, Yizhan Shao, Zhongkai Xu","year":"2020","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Liu et al., 2023] Jiajun Liu, Peng Wang, Ziyu Shang, and Chenxiao Wu. Iterde: an iterative knowledge distillation framework for knowledge graph embeddings. In AAAI, 2023.","title":"Iterde: an iterative knowledge distillation framework for knowledge graph embeddings","authors":"Jiajun Liu, Peng Wang, Ziyu Shang, Chenxiao Wu","year":"2023","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Liu et al., 2024] Jiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang, Jinhua Gao, Guozheng Li, Ke Ji, and Yanhe Liu. Towards continual knowledge graph embedding via incre- mental distillation. In AAAI, 2024.","title":"Towards continual knowledge graph embedding via incremental distillation","authors":"Jiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang, Jinhua Gao, Guozheng Li, Ke Ji, Yanhe Liu","year":"2024","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lomonaco and Maltoni, 2017] Vincenzo Lomonaco and Davide Maltoni. Core50: a new dataset and benchmark for continuous object recognition. In CoRL, 2017.","title":"Core50: a new dataset and benchmark for continuous object recognition","authors":"Vincenzo Lomonaco, Davide Maltoni","year":"2017","venue":"CoRL","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Lopez-Paz and Ranzato, 2017] David Lopez-Paz and Marc'Aurelio Ranzato. Gradient episodic memory for continual learning. In NIPS, 2017.","title":"Gradient episodic memory for continual learning","authors":"David Lopez, - Paz, Marc'aurelio Ranzato","year":"2017","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Pan and Wang, 2021] Zhe Pan and Peng Wang. Hyperbolic hierarchy-aware knowledge graph embedding for link pre- diction. In EMNLP, 2021.","title":"Hyperbolic hierarchy-aware knowledge graph embedding for link prediction","authors":"Zhe Pan, Peng Wang","year":"2021","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Paszke et al., 2019] Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, and et al. Pytorch: An imperative style, high-performance deep learning li- brary. In NeurIPS, 2019.","title":"Pytorch: An imperative style, high-performance deep learning library","authors":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Radford et al., 2019] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.","title":"Language models are unsupervised multitask learners","authors":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever","year":"2019","venue":"OpenAI blog","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Rossi et al., 2021] Andrea Rossi, Denilson Barbosa, Do- natella Firmani, Antonio Matinata, and Paolo Merialdo. Knowledge graph embedding for link prediction: A com- parative analysis. ACM Transactions on Knowledge Dis- covery from Data (TKDD), 15(2):1-49, 2021.","title":"Knowledge graph embedding for link prediction: A comparative analysis","authors":"Andrea Rossi, Denilson Barbosa, Donatella Firmani, Antonio Matinata, Paolo Merialdo","year":"2021","venue":"ACM Transactions on Knowledge Discovery from Data (TKDD)","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Rusu et al., 2016] Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Had- sell. Progressive neural networks. arXiv preprint arXiv:1606.04671, 2016.","title":"Progressive neural networks","authors":"Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, Raia Hadsell","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Shang et al., 2023] Ziyu Shang, Peng Wang, Yuzhang Liu, Jiajun Liu, and Wenjun Ke. Askrl: An aligned-spatial knowledge representation learning framework for open- world knowledge graph. In ISWC, 2023.","title":"Askrl: An aligned-spatial knowledge representation learning framework for openworld knowledge graph","authors":"Ziyu Shang, Peng Wang, Yuzhang Liu, Jiajun Liu, Wenjun Ke","year":"2023","venue":"ISWC","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Shang et al., 2024] Ziyu Shang, Wenjun Ke, Nana Xiu, Peng Wang, Jiajun Liu, Yanhui Li, Zhizhao Luo, and Ke Ji. Ontofact: Unveiling fantastic fact-skeleton of llms via ontology-driven reinforcement learning. In AAAI, 2024.","title":"Ontofact: Unveiling fantastic fact-skeleton of llms via ontology-driven reinforcement learning","authors":"Ziyu Shang, Wenjun Ke, Nana Xiu, Peng Wang, Jiajun Liu, Yanhui Li, Zhizhao Luo, Ke Ji","year":"2024","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Song and Park, 2018] Hyun-Je Song and Seong-Bae Park. Enriching translation-based knowledge graph embeddings through continual learning. IEEE Access, 6:60489-60497, 2018.","title":"Enriching translation-based knowledge graph embeddings through continual learning","authors":"Hyun-Je Song, Seong-Bae Park","year":"2018","venue":"IEEE Access","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Suchanek et al., 2007] Fabian M. Suchanek, Gjergji Kas- neci, and Gerhard Weikum. Yago: A core of semantic knowledge. In WWW, 2007.","title":"Yago: A core of semantic knowledge","authors":"Fabian M Suchanek, Gjergji Kasneci, Gerhard Weikum","year":"2007","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Sun et al., 2019] Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. Rotate: Knowledge graph embedding by relational rotation in complex space. In ICLR, 2019.","title":"Rotate: Knowledge graph embedding by relational rotation in complex space","authors":"Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, Jian Tang","year":"2019","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Toutanova et al., 2015] Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, and Michael Gamon. Representing text for joint embedding of text and knowledge bases. In EMNLP, 2015.","title":"Representing text for joint embedding of text and knowledge bases","authors":"Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, Michael Gamon","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Trouillon et al., 2016] Théo Trouillon, Johannes Welbl, Se- bastian Riedel, Éric Gaussier, and Guillaume Bouchard. Complex embeddings for simple link prediction. In ICML, 2016.","title":"Complex embeddings for simple link prediction","authors":"Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, Guillaume Bouchard","year":"2016","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Vrandečić and Krötzsch, 2014] Denny Vrandečić and Markus Krötzsch. Wikidata: a free collaborative knowl- edgebase. Communications of the ACM, 57(10):78-85, 2014.","title":"Wikidata: a free collaborative knowledgebase","authors":"Krötzsch Vrandečić, Denny Vrandečić, Markus Krötzsch","year":"2014","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Wang et al., 2017] Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. Knowledge graph embedding: A survey of ap- proaches and applications. IEEE Transactions on Knowl- edge and Data Engineering, 29(12):2724-2743, 2017.","title":"Knowledge graph embedding: A survey of approaches and applications","authors":"Quan Wang, Zhendong Mao, Bin Wang, Li Guo","year":"2017","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Wang et al., 2019] Hong Wang, Wenhan Xiong, Mo Yu, Xi- aoxiao Guo, Shiyu Chang, and William Yang Wang. Sen- tence embedding alignment for lifelong relation extrac- tion. In NAACL, 2019.","title":"Sentence embedding alignment for lifelong relation extraction","authors":"Wang","year":"2019","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Wang et al., 2023] Xiao Wang, Tianze Chen, Qiming Ge, Han Xia, Rong Bao, Rui Zheng, Qi Zhang, Tao Gui, and Xuanjing Huang. Orthogonal subspace learning for language model continual learning. arXiv preprint arXiv:2310.14152, 2023.","title":"Orthogonal subspace learning for language model continual learning","authors":"Xiao Wang, Tianze Chen, Qiming Ge, Han Xia, Rong Bao, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Wikidata, 2023] Wikidata. Welcome to wikidata. https:// www.wikidata.org/wiki/Wikidata:Main Page/, 2023. Ac- cessed: 2023-10-01.","title":"Wikidata. Welcome to wikidata","authors":"Wikidata","year":"2023","venue":null,"doi":null,"url":"-cessed:2023-10-01","internal_url":null},{"position":39,"raw":"[Xu et al., 2023] Zijie Xu, Peng Wang, Ziyu Shang, and Ji- ajun Liu. A two-stage label rectification framework for noisy event extraction. In DASFAA, 2023.","title":"A two-stage label rectification framework for noisy event extraction","authors":"Zijie Xu, Peng Wang, Ziyu Shang, Jiajun Liu","year":"2023","venue":"DASFAA","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Zenke et al., 2017] Friedemann Zenke, Ben Poole, and Surya Ganguli. Continual learning through synaptic in- telligence. In ICML, 2017.","title":"Continual learning through synaptic intelligence","authors":"Friedemann Zenke, Ben Poole, Surya Ganguli","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Zhang et al., 2016] Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. Collaborative knowledge base embedding for recommender systems. In SIGKDD, 2016.","title":"Collaborative knowledge base embedding for recommender systems","authors":"Zhang","year":"2016","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Zhang et al., 2023] Qingru Zhang, Minshuo Chen, Alexan- der Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, and Tuo Zhao. Adaptive budget allocation for parameter- efficient fine-tuning. In ICLR, 2023.","title":"Adaptive budget allocation for parameterefficient fine-tuning","authors":"Zhang","year":"2023","venue":"ICLR","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}