École polytechnique researchers develop 3D sound spatialization software

The result of a collaboration with the Conservatoire National Supérieur de Musique et de Danse de Paris, the software developed by X researchers enables sound recordings containing up to 48 channels to be mixed and listened to using only headphones. By manually defining the position of the sound sources, and while tracking the position of the head, the MyBino software enables the user to perceive the movement of sound in space (a plane flying over the listener, for example).

To achieve this, CMAP researchers use complex mathematical calculations to model precisely the functions involved in the subjective construction of a sound space(Head-Related Transfer Function and Room Impulse Responses). By numerically calculating the circulation of sound waves in a defined environment (mixing studio, auditorium, historical monument, etc.), CMAP sets out to reproduce the "sound field", i.e. the characteristics of acoustic waves at every point in the space, particularly in the hollow of the auricle.

The sound rendering quality achieved by MyBino opens up a wide range of applications. Firstly, it offers an affordable alternative to sound engineers who can work on their multi-channel mixes with headphones, making up for, but not replacing, conventional multi-speaker setups. It also gives listeners easier access to these mixes. Secondly, this software is ideally suited to the audio rendering that can accompany virtual reality devices. It makes the virtual universe more realistic, while limiting the effects of cybersickness (nausea caused by the arrival of contradictory visual and auditory information in the brain). Finally, when combined with a spatial localization device, MyBino can guide people using sound signals.

Experiments carried out in partnership with the "MixHandi Cap sur la vie" association have already enabled Stéphane le Sueur, a blind athlete, to run and rollerblade following a spatialized sound source. This research could enable the visually impaired to take part in sporting activities with greater autonomy, thus responding to a major social challenge.

Creation of a "software" consortium

Ultimately, the software developed by X researchers, in conjunction with the Conservatoire National Supérieur de Musique et de Danse de Paris, can be used in a wide variety of applications. This is why the X-Audio team is proposing to potential industrial or academic partners to join a software consortium currently being set up, in order to finance the maintenance and evolution of the software, thus defining the development priorities for the X-Audio team.