Skip to Main content Skip to Navigation
Journal articles

Ears on the Hand: Reaching Three-Dimensional Targets With an Audio-Motor Device

Abstract : Understanding the processes underlying sensorimotor coupling with the environment is crucial for sensorimotor rehabilitation and sensory substitution. In doing so, devices which provide novel sensory feedback consequent to body movement may be optimized in order to enhance motor performance for particular tasks. The aim of the study reported here was to investigate audio-motor coupling when the auditory experience is linked to movements of the head or the hands. The participants had to localize and reach a virtual source with the dominant hand in response to sounds. An electromagnetic system recorded the position and orientation of the participants’ head and hands. This system was connected to a 3D audio system that provided binaural auditory feedback on the position of the virtual listener located on the participants’ body. The listener’s position was computed either from the hands or from the head. For the hand condition, the virtual listener was placed on the dominant hand (the one used to reach the target) in Experiment 1 and on the nondominant hand, which was constrained in order to have similar amplitude and degrees of freedom as that of the head, in Experiment 2. The results revealed that, in the two experiments, the participants were able to localize a source within the 3D auditory environment. Performance varied as a function of the effector’s degrees of freedom and the spatial coincidence between sensor and effector. The results also allowed characterizing the kinematics of the hand and head and how they change with audio-motor coupling condition and practice.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02475383
Contributor : Sylvain Hanneton <>
Submitted on : Thursday, December 31, 2020 - 4:00:15 PM
Last modification on : Tuesday, March 2, 2021 - 11:58:05 AM

File

MSR-ears-final-author.pdf
Files produced by the author(s)

Identifiers

Citation

Sylvain Hanneton, Thomas Hoellinger, Vincent Forma, Agnes Roby-Brami, Malika Auvray. Ears on the Hand: Reaching Three-Dimensional Targets With an Audio-Motor Device. Multisensory Research, Brill, 2020, 4-5, pp.433-455. ⟨10.1163/22134808-20191436⟩. ⟨hal-02475383⟩

Share

Metrics

Record views

402

Files downloads

40