Proceedings

Towards Scalable Metaverse Systems with Social-Aware VR Displays

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI4Tech: AI Enabling Technologies. Pages 6445-6453.

https://doi.org/10.24963/ijcai.2026/717

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

The Metaverse is envisioned to support immersive, large-scale social interactions via virtual reality (VR) displays. However, scalability remains a major bottleneck: as the number of concurrent users grows, tracking and updating display content incurs quadratic overhead, often limiting a shared virtual space to only a few dozen participants. Our key observation is that user attention in social VR is highly selective, with users primarily focusing on socially relevant peers rather than all visible users. Motivated by this observation, we propose SAGE, a social-aware graph-based VR display framework that enables personalized displays based on inferred social relevance. SAGE introduces a dual-graph learning architecture to jointly model long-term social structures and short-term spatiotemporal co-presence patterns, generating complementary interest scores for display prioritization. Based on these scores, we formulate scalable VR display support as a multi-dimensional resource allocation problem and design a lightweight coordination mechanism with provable guarantees, including incentive compatibility and individual rationality. Experiments on Metaverse datasets show that SAGE improves interaction-relevance prediction by 11.64% and increases social welfare by up to 2.4× compared to state-of-the-art schemes. It scales to support up to 1,000 concurrent users and remains robust against strategic manipulation.

  1. [Blumrosen and Nisan, 2007] Liad Blumrosen and Noam Nisan. Combinatorial auctions. Algorithmic Game The- ory, 267:300, 2007.
  2. [Chen and Yang, 2022] Bing-Jyue Chen and De-Nian Yang. User recommendation in social metaverse with VR. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (CIKM), pages 148-158, 2022.
  3. [Chen et al., 2024] Bing-Jyue Chen, Chiok Yew Ho, and De-Nian Yang. AFTER: Adaptive friend discovery for temporal-spatial and social-aware XR. In Proceedings of the IEEE 40th International Conference on Data Engi- neering (ICDE), pages 2639-2652, 2024.
  4. [Cheng et al., 2021] Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, and David Lindlbauer. SemanticAdapt: Optimization-based adaptation of mixed reality layouts leveraging virtual-physical semantic connections. In Pro- ceedings of the 34th Annual ACM Symposium on User In- terface Software and Technology (UIST), pages 282-297, 2021.
  5. [Cho et al., 2014] Kyunghyun Cho, Bart Van Merriënboer, C ¸aglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using rnn encoder-decoder for statisti- cal machine translation. In Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1724-1734, 2014.
  6. [Du et al., 2023] Hongyang Du, Jiazhen Liu, Dusit Niyato, Jiawen Kang, Zehui Xiong, Junshan Zhang, and Dong In Kim. Attention-aware resource allocation and QoE analy- sis for metaverse xurllc services. IEEE Journal on Selected Areas in Communications, 41(7):2158-2175, 2023.
  7. [Feng and Zhao, 2025] Jie Feng and Jun Zhao. Resource allocation for augmented reality empowered vehicular edge metaverse. IEEE Transactions on Communications, 73(3):1987-2001, 2025.
  8. [Feng et al., 2025] Lei Feng, Xiaoyi Jiang, Yao Sun, Dusit Niyato, Yu Zhou, Shiyi Gu, Zhixiang Yang, Yang Yang, and Fanqin Zhou. Resource allocation for metaverse ex- perience optimization: A multi-objective multi-agent evo- lutionary reinforcement learning approach. IEEE Trans- actions on Mobile Computing, 24(4):3473-3488, 2025.
  9. [Greff et al., 2017] Klaus Greff, Rupesh K. Srivastava, Jan Koutník, Bas R. Steunebrink, and Jürgen Schmidhuber. LSTM: A search space odyssey. IEEE Transactions on Neural Networks and Learning Systems, 28(10):2222- 2232, 2017.
  10. [Guo et al., 2024] Beizhang Guo, Juntao Bao, Baili Chai, Di Wu, and Miao Hu. Lumos: Optimizing live 360-degree video upstreaming via spatial-temporal integrated neural enhancement. In Proceedings of the 32nd ACM Inter- national Conference on Multimedia (MM), pages 7210- 7219, 2024.
  11. [Haeberlen et al., 2023] Andreas Haeberlen, Linh Thi Xuan Phan, and Morgan McGuire. Metaverse as a service: Megascale social 3D on the cloud. In Proceedings of the 2023 ACM Symposium on Cloud Computing (SoCC), pages 298-307, 2023.
  12. [Hsu et al., 2024] Bay-Yuan Hsu, Chih-Ya Shen, Hao Shan Yuan, Wang-Chien Lee, and De-Nian Yang. Social-Aware Group Display Configuration in VR Conference. In Pro- ceedings of the AAAI Conference on Artificial Intelligence (AAAI), volume 38, pages 8517-8525, 2024.
  13. [Hu et al., 2026] Qinnan Hu, Yuntao Wang, Zhou Su, Shao- long Guo, Yuan Gao, Nan Liu, and Tom H. Luan. BlockA- thena: A scalable approach for long-term blockchain crimes analysis. IEEE Transactions on Information Foren- sics and Security, pages 1-16, 2026. Early Access.
  14. [Jiang et al., 2023] Yuna Jiang, Jiawen Kang, Xiaohu Ge, Dusit Niyato, and Zehui Xiong. QoE analysis and resource allocation for wireless metaverse services. IEEE Transac- tions on Communications, 71(8):4735-4750, 2023.
  15. [Kipf and Welling, 2017] Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In Proceedings of International Conference on Learning Representations (ICLR), pages 1-14, 2017.
  16. [Lai et al., 2020] Zeqi Lai, Y. Charlie Hu, Yong Cui, Linhui Sun, Ningwei Dai, and Hung-Sheng Lee. Furion: Engi- neering high-quality immersive virtual reality on today's mobile devices. IEEE Transactions on Mobile Computing, 19(7):1586-1602, 2020.
  17. [Lehmann et al., 2002] Daniel Lehmann, Liadan Ita Oćallaghan, and Yoav Shoham. Truth revelation in approximately efficient combinatorial auctions. Journal of the ACM, 49(5):577-602, 2002.
  18. [Li et al., 2025a] Weimin Li, Qin Li, Weihong Tian, Jie Gao, Fan Wu, Jianxun Liu, and Ju Ren. MUCVR: Edge computing-enabled high-quality multi-user collaboration for interactive MVR. IEEE Transactions on Parallel and Distributed Systems, 36(10):2058-2072, 2025.
  19. [Li et al., 2025b] Xinping Li, Yan Hong, Meng Zhang, Xiangpeng Xie, Jie Zhang, and Song Guo. Social group oriented recommendation systems in wireless edge- empowered metaverse. IEEE Network, 39(3):270-276, 2025.
  20. [Liu et al., 2025] Nan Liu, Tom H. Luan, Yuntao Wang, Yil- iang Liu, and Zhou Su. QoE-oriented cooperative vr ren- dering and dynamic resource leasing in metaverse. IEEE Transactions on Mobile Computing, 24(10):10247-10263, 2025.
  21. [Luong et al., 2017] Nguyen Cong Luong, Ping Wang, Dusit Niyato, Yonggang Wen, and Zhu Han. Resource man- agement in cloud networking using economic analysis and pricing models: A survey. IEEE Communications Surveys & Tutorials, 19(2):954-1001, 2017.
  22. [Meng et al., 2020] Jiayi Meng, Sibendu Paul, and Y. Char- lie Hu. Coterie: Exploiting frame similarity to enable high-quality multiplayer VR on commodity mobile de- vices. In Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 923- 937, 2020.
  23. [Ooi et al., 2023] Beng Chin Ooi, Gang Chen, Mike Zheng Shou, Kian-Lee Tan, Anthony Tung, Xiaokui Xiao, James Wei Luen Yip, Bingxue Zhang, and Meihui Zhang. The metaverse data deluge: What can we do about it? In Proceedings of the IEEE 39th International Conference on Data Engineering (ICDE), pages 3675-3687, 2023.
  24. [Sapiezynski et al., 2019] Piotr Sapiezynski, Arkadiusz Stopczynski, David Dreyer Lassen, and Sune Lehmann. Interaction data from the copenhagen networks study. Scientific Data, 6(1):315, 2019.
  25. [Steinert et al., 2024] Patrick Steinert, Stefan Wagenpfeil, Ingo Frommholz, and Matthias L. Hemmje. 256 metaverse records dataset. In Proceedings of the 32nd ACM Interna- tional Conference on Multimedia (MM), page 4256-4263, 2024.
  26. [Su et al., 2022] Zhou Su, Yuntao Wang, Qichao Xu, and Ning Zhang. LVBS: Lightweight vehicular blockchain for secure data sharing in disaster rescue. IEEE Transac- tions on Dependable and Secure Computing, 19(1):19-32, 2022.
  27. [Tan et al., 2022] Yu Wei Tan, Alden Tan, Nicholas Nge, and Anand Bhojan. DHR: Distributed hybrid rendering for metaverse experiences. In Proceedings of the 1st Work- shop on Interactive eXtended Reality (IXR), pages 51-59, 2022.
  28. [Veličković et al., 2018] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. In Proceedings of International Conference on Learning Representations (ICLR), pages 1-12, 2018.
  29. [Wang et al., 2022] Yuntao Wang, Zhou Su, Ning Zhang, Rui Xing, Dongxiao Liu, Tom H Luan, and Xuemin Shen. A survey on metaverse: Fundamentals, security, and privacy. IEEE Communications Surveys & Tutorials, 25(1):319-352, 2022.
  30. [Wang et al., 2023] Yuntao Wang, Zhou Su, Qichao Xu, Ruidong Li, Tom H. Luan, and Pinghui Wang. A se- cure and intelligent data sharing scheme for uav-assisted disaster rescue. IEEE/ACM Transactions on Networking, 31(6):2422-2438, 2023.
  31. [Xu et al., 2019] Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. How powerful are graph neural net- works? In Proceedings of International Conference on Learning Representations (ICLR), pages 1-17, 2019.
  32. [Yu et al., 2024] Jiadong Yu, Ahmad Yousef Alhilal, Tailin Zhou, Pan Hui, and Danny HK Tsang. Attention-based QoE-aware digital twin empowered edge computing for immersive virtual reality. IEEE Transactions on Wireless Communications, 23(9):11276-11290, 2024.
  33. [Zhang et al., 2024] Ziliang Zhang, Zexin Li, Hyoseung Kim, and Cong Liu. BOXR: Body and head motion op- timization framework for extended reality. In Proceedings of the 2024 IEEE Real-Time Systems Symposium (RTSS), pages 70-82, 2024.
  34. [Zhao et al., 2024] Jun Zhao, Liangxin Qian, and Wenhan Yu. Human-centric resource allocation in the metaverse over wireless communications. IEEE Journal on Selected Areas in Communications, 42(3):514-537, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards