WebGazer: Scalable Webcam Eye Tracking Using User Interactions

Papoutsaki, Alexandra; Sangkloy, Patsorn; Laskey, James; Daskalova, Nediyana; Huang, Jeff; Hays, James

WebGazer: Scalable Webcam Eye Tracking Using User Interactions

Alexandra Papoutsaki, Patsorn Sangkloy, James Laskey, Nediyana Daskalova, Jeff Huang, James Hays

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 3839-3844.

Abstract

We introduce WebGazer, an online eye tracker that uses common webcams already present in laptops and mobile devices to infer the eye-gaze locations of web visitors on a page in real time. The eye tracking model self-calibrates by watching web visitors interact with the web page and trains a mapping between features of the eye and positions on the screen. This approach aims to provide a natural experience to everyday users that is not restricted to laboratories and highly controlled user studies. WebGazer has two key components: a pupil detector that can be combined with any eye detection library, and a gaze estimator using regression analysis informed by user interactions. We perform a large remote online study and a small in-person study to evaluate WebGazer. The findings show that WebGazer can learn from user interactions and that its accuracy is sufficient for approximating the user's gaze. As part of this paper, we release the first eye tracking library that can be easily integrated in any website for real-time gaze interactions, usability studies, or web research.

Alexandra Papoutsaki, Patsorn Sangkloy, James Laskey, Nediyana Daskalova, Jeff Huang, and James Hays. 2016. WebGazer: Scalable Webcam Eye Tracking Using User Interactions. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16. IJCAI, 3839–3844. https://ijcai.org/proceedings/2016/540

@inproceedings{ijcai2016p540,
  title     = {WebGazer: Scalable Webcam Eye Tracking Using User Interactions},
  author    = {Papoutsaki, Alexandra and Sangkloy, Patsorn and Laskey, James and Daskalova, Nediyana and Huang, Jeff and Hays, James},
  booktitle = {Proceedings of the Twenty-Fifth International Joint Conference on
               Artificial Intelligence, {IJCAI-16}},
  publisher = {AAAI Press / International Joint Conferences on Artificial Intelligence},
  editor    = {Subbarao Kambhampati},
  pages     = {3839--3844},
  year      = {2016},
  month     = {7},
  url       = {https://ijcai.org/proceedings/2016/540},
}

TY  - CPAPER
TI  - WebGazer: Scalable Webcam Eye Tracking Using User Interactions
AU  - Papoutsaki, Alexandra
AU  - Sangkloy, Patsorn
AU  - Laskey, James
AU  - Daskalova, Nediyana
AU  - Huang, Jeff
AU  - Hays, James
T2  - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16
PB  - AAAI Press / International Joint Conferences on Artificial Intelligence
PY  - 2016
SP  - 3839
EP  - 3844
UR  - https://ijcai.org/proceedings/2016/540
ER  -