TTO_Grant Catalogue Grant Catalogue | Page 16

Simultaneous Tracking of Head Motion and Occlusion Regions Using Multi-Modal Sensors for Augmented Reality Applications ABSTRACT Computer Science In this project, we will develop novel methods and technologies for tracking head motion and occluders using multi-modal sensors to achieve a more immersive augmented reality experience in cultural heritage applications. For a high feeling of immersion, real and virtual objects have to be aligned correctly in 3D. Therefore, the video sent to both eyes of the user has to be rendered according to the position and orientation of the user’s head. This necessitates the user’s head to be tracked accurately. In case there are moving people in the scene, the regions occluded by these people will be tracked as well, and these reg [ۜ