{"type":"ScholarlyArticle","title":"Eye-See-You: Reverse Pass-Through VR and Head Avatars","authors":[{"name":"Ankan Dash","slug":"ankan-dash","given":"Ankan","family":"Dash","affiliation":""},{"name":"Jingyi Gu","slug":"jingyi-gu","given":"Jingyi","family":"Gu","affiliation":""},{"name":"Guiling Wang","slug":"guiling-wang","given":"Guiling","family":"Wang","affiliation":""},{"name":"Chen Chen","slug":"chen-chen","given":"Chen","family":"Chen","affiliation":""}],"abstract":"Virtual Reality (VR) headsets, while integral to the evolving digital ecosystem, present a critical challenge: the occlusion of users' eyes and portions of their faces, which hinders visual communication and may contribute to social isolation. To address this, we introduce RevAvatar, an innovative framework that leverages AI methodologies to enable reverse pass-through technology, fundamentally transforming VR headset design and interaction paradigms. RevAvatar integrates state-of-the-art generative models and multimodal AI techniques to reconstruct high-fidelity 2D facial images and generate accurate 3D head avatars from partially observed eye and lower-face regions. This framework represents a significant advancement in AI4Tech by enabling seamless interaction between virtual and physical environments, fostering immersive experiences such as VR meetings and social engagements. Additionally, we present VR-Face, a novel dataset comprising 200,000 samples designed to emulate diverse VR-specific conditions, including occlusions, lighting variations, and distortions. By addressing fundamental limitations in current VR systems, RevAvatar exemplifies the transformative synergy between AI and next-generation technologies, offering a robust platform for enhancing human connection and interaction in virtual environments.","doi":"10.24963/ijcai.2025/1020","url":"https://ijcai.org/proceedings/2025/1020","pdf":"https://ijcai.org/proceedings/2025/1020.pdf","markdown":"https://ijcai.org/proceedings/2025/1020.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/1020","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"AI4Tech: AI Enabling Technologies","track":"AI4Tech: AI Enabling Technologies","number":1020,"pages":{"first":9176,"last":9184},"keywords":["Advanced AI4Tech: Deep AI4Tech","Advanced AI4Tech: Metaverse AI4Tech","Advanced AI4Tech: Data-driven AI4Tech"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}