Real-time 3D gaze analysis in mobile applications

Conference paper


Jan Hendrik Hammer
Michael Maurus
Jürgen Beyerer


Proceedings of the 2013 Conference on Eye Tracking South Africa, ETSA '13, ACM, 2013.




Eye Tracking South Africa (ETSA 2013), Cape Town, South Africa, August 29 - 31, 2013



This paper presents a system for real-time analysis of 3D gaze data arising in mobile applications. Our system allows users to freely move in a known 3D environment while their gaze is computed on arbitrarily shaped objects. The scanpath is analysed fully automatically using fixations and areas-of-interest – all in 3D and real time. Furthermore, the scanpath can be visualized in parallel in a 3D model of the environment. This enables to observe the scanning behaviour of a subject. We describe how this has been realized for a commercial off-the-shelf mobile eye tracker utilizing an inside-out tracking mechanism for head pose estimation. Moreover, we show examples of real gaze data collected in a museum.