Contribution to the study of projection-based systems for industrial applications in mixed reality

Guillaume Cortes 1
1 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : Mixed reality brings some advantages to industrial applications. It can, among others, facilitate visualizing and validating projects or assist operators during specific tasks. Projection-based Systems (PBS), such as CAVEs or spatial augmented reality provide a mixed reality environment enabling straightforward collaboration with external users. In this thesis, we aim at improving the usage of PBS for industrial applications by considering two main challenges: (1) improving the technical components of PBS and (2) improving the user experience when using PBS. As a first technical challenge, we propose to address the improvement of the tracking component. We introduce an approach that enables increasing the workspace of optical tracking systems by using two methods. As a first method, we propose to use monocular tracking. As a second method, we propose to use controlled cameras that follow the targets across the workspace. The resulting system provides acceptable performances for mixed reality applications while considerably increasing the workspace. Such a tracking system can make it easier to use large projection-based displays and can widen the range of available interactions. As a second technical challenge, we design an “all-in-one” headset for mobile spatial augmented reality on tangible objects. The headset gathers both a projection and a tracking system that are embedded on the user’s head. With such a system, the users are able to move around tangible objects and to manipulate them directly by hand while projecting virtual content over them. We illustrate our system with two industrial use cases: virtual prototyping and medical visualization. Finally, we address the challenge that aims at improving the user experience when using PBS. We introduce a method that provides virtual embodiment and increases the spatial perception of the users when using PBS. To do so we add the user’s virtual shadow in immersive projection-based systems. The virtual shadow is dynamically mapped to users’ movements in order to make them perceive the shadow as if it was their own. We then carry out an experiment to study the influence of the presence of the virtual shadow on the user experience and behavior.
Document type :
Complete list of metadatas

Cited literature [212 references]  Display  Hide  Download
Contributor : Abes Star <>
Submitted on : Friday, February 1, 2019 - 12:59:49 PM
Last modification on : Friday, September 13, 2019 - 9:48:03 AM
Long-term archiving on : Thursday, May 2, 2019 - 12:36:00 PM


Version validated by the jury (STAR)


  • HAL Id : tel-02000387, version 1


Guillaume Cortes. Contribution to the study of projection-based systems for industrial applications in mixed reality. Graphics [cs.GR]. Université Rennes 1, 2018. English. ⟨NNT : 2018REN1S044⟩. ⟨tel-02000387⟩



Record views


Files downloads