Skip to Main content Skip to Navigation
New interface

Improving mediated touch interaction with multimodality

Abstract : As one of the most important non-verbal communication channels, touch is widely used for different purposes. It is a powerful force in human physical and psychological development, shaping social structures as well as communicating emotions. However, even though current information and communication technology (ICT) systems enable the use of various non-verbal languages, the support of communicating through the sense of touch is still insufficient. Inspired by the cross-modal interaction of human perception, the approach I present in this dissertation is to use multimodality to improve mediated touch interaction. Following this approach, I present three devices that provide empirical contributions to multimodal touch interaction: VisualTouch, SansTouch, and In-Flat. To understand if multimodal stimuli can improve the emotional perception of touch, I present the VisualTouch device, and quantitatively evaluate the cross-modal interaction between the visual and tactile modality. To investigate the use of different modalities in real touch communication, I present the SansTouch device, which provides empirical insights on multimodal interaction and skin-like touch generation in the context of face-to-face communication. Going one step forward in the use of multimodal stimuli in touch interaction, I present the In-Flat device, an input/output touch overlay for smartphones. In-Flat not only provides further insights on the skin-like touch generation, but also a better understanding of the role that mediated touch plays in more general contexts. In summary, this dissertation strives to bridge the gap between touch communication and HCI, by contributing to the design and understanding of multimodal stimuli in mediated touch interaction.
Complete list of metadata
Contributor : ABES STAR :  Contact
Submitted on : Saturday, June 18, 2022 - 6:30:50 AM
Last modification on : Monday, June 20, 2022 - 3:37:40 PM


Version validated by the jury (STAR)


  • HAL Id : tel-03698460, version 1


Zhuoming Zhang. Improving mediated touch interaction with multimodality. Human-Computer Interaction [cs.HC]. Institut Polytechnique de Paris, 2022. English. ⟨NNT : 2022IPPAT017⟩. ⟨tel-03698460⟩



Record views


Files downloads