What is the new music experience?

We propose “Avatar Jockey” which aims to expand the music experience using Mixed Reality.

What is Avatar Jockey?

“Avatar Jockey” is an application of HoloLens2 that allows you to freely arrange your avatar as a musical instrument in the space and build a musical space for 3D sound in real time.

“Avatar Jockey” is also defined as 3D Audio Visual Sampler from its feature.

※Avatar Jockey introduction video

Feature

The features of “Avatar Jockey” are as follows.
1. The avatar is the sound source.
2. Intuitive UI.
3. Sharing the music experience with multiple people.

1. The avatar is the sound source.

AirTap the space and the Avatar will appear.

AirTap the appearing Avatar, starts to dance and sound starts to play from the Avatar.(The example in the photo is an avatar that sounds a rhythm.)

Avatar is a sound source.

2.Intuitive UI.

Select the Avatar type by the position of the hand where you want to AirTap.

Vertical: Type of instrument
From the bottom, Drum, Bass, Code, Melody, Voice
Horizontal: 3 types of instrumental phrases

Display phrase and instrument that are selected in center of the playerʼs view.

3.Sharing the music experience with multiple people

Players can see each other’s avatars by sharing the MR space.
Also the sound is shared, the session using Avatar is possible.

Avatar Jockey is a joint research project between Tokyo Computer Services and the Institute of Advanced Media Arts and Sciences (IAMAS).

This application is the result of the "development of a representation system using MR and research on its potential for development".

Please contact us if you are interested in our MR-based representation system.