ELMIRAIVE

**ELMIRAIVE** is the research brand of technology created by Bandai Namco Research Inc. . It was announced on March 30, 2023 and spans a range of various technologies developed by Bandai Namco including:

* ***ELMIRAIVE VOX/Singer***
* ***ELMIRAIVE AX***
* ***ELMIRAIVE CX***
* ***ELMIRAIVE 360***
* ***ELMIRAIVE K-seg/Streamer***

## History

On March 30, 2023, the official Mirai Komachi PR Twitter account announced the ELMIRAIVE project, a new technology research subgroup and brand of Bandai Namco Research Inc. The project was developed as a way for creators to interact with their favorite characters, connect with the world, and see future character entertainment experiences with AI and extended reality (XR) technology explored by the BANDAI NAMCO Research Institute. ELMIRAIVE proposes five areas of technology including speech and singing synthesis, AR, video production, and streaming services.

### ELMIRAIVE VOX/Singer

#### VOX

**ELMIRAIVE VOX** is a speech synthesis technology that is able to reproduce natural and expressive speech, reproduce human voice quality and habits, and interact with characters. It not only contributes to the efficiency and diversification of content production, but also greatly improves the interactive user experience. Using unique design expertise to express character traits, Bandai Namco has developed AI voice synthesis models that represent characters, rather than robotic narrators.

##### Voice Conversion

Using AI technology, ELMIRAIVE offers voice conversion technology to transform a human voice into that of a different person, rather than simply controlling pitch and formants like conventional methods.

##### Speech Recognition

AI automates tasks that were previously done by hand, such as consistency checks between recorded audio and the script, or spot the places in the video where the script lines are used.

#### Singer

**ELMIRAIVE Singer** is a singing synthesis engine that produces natural-sounding vocals, users can add their own unique singing voice to their favorite songs, and have a character sing on their behalf. It makes music production and hobbies more enjoyable and bringing users closer to the music.

##### Learning Data

A singing synthesis model can be created by machine learning from about one to two hours of singing audio and music sheet data.

##### Multi-language Support

AI Model development is possible not only for Japanese singers but also for non-Japanese language singers.

### ELMIRAIVE AX

**ELMIRAIVE AX** is a live performance system that utilizes the metadata such as tempo, measures, beats, tension, and emotions found in music, as well as the buildup of the song creating a system that automatically controls character movements, visual effects, and even the user's device through a network, seamlessly connecting live content with the user's viewing experience.

### ELMIRAIVE CX

**ELMIRAIVE CX** known as the "Character Experience Engine" (CX) was developed to meet the demand for more flexible use of 3D character models created for games and anime in various media and content. By unifying character control method through the CX hub and combining a variety of technologies, such as high-end optical capture systems, XR camera tracking, simple motion capture using smartphones, and AR synthesis, users can flexibly create character live video and contents in various environments.

### ELMIRAIVE 360

**ELMIRAIVE 360** is a technology that allows users to experience various events while exploring panoramic photos or panoramic video spaces, similar to Street View. In the content offered on this system, users can enter into the world of panoramas and see a wider field of view from your perspective, which allows users to enjoy a high level of immersion and exploration.

### ELMIRAIVE K-seg/Streamer

**ELMIRAIVE K-seg/Streamer** is a technology that links actions by viewers on streaming platforms, such as commenting and gifting, with various productions and interactions with characters in the metaverse or live venue, bringing the excitement of viewers to the live space and creating a sense of unity and excitement between the live venue and the streaming platform.

## References

1. ↑ https://twitter.com/miraikomachi\_PR/status/1641794815565393920
2. ↑ https://elmiraive.tech/articles/About
3. ↑ https://elmiraive.tech/articles/vox
4. ↑ https://elmiraive.tech/articles/AX
5. ↑ https://elmiraive.tech/articles/CX
6. ↑ https://elmiraive.tech/articles/360
7. ↑ https://elmiraive.tech/articles/K-seg

## External links

### Official

* ELMIRAIVE website
* Bandai Namco Research Inc. Official Website
* Official Mirai Komachi Website
* Mirai komachi PR Twitter (@miraikomachi\_PR)