Mai (Synthesizer V Studio)

**This article is about the Synthesizer V Studio software known as a voice database. If you are looking for the Synthesizer V concept then click here.**

## History

### 2022

On October 27, 2022, Dreamtonics announced a new feminine Japanese voice database known as Mai and released one demo for her debut with a brief description of her voice database. The editor in the demo's PV also revealed that Mai had at least two Vocal Modes: "Emotional" and "Soft". A release date had yet to be announced at the time.

On November 10, Synthesizer V Studio 1.8.0b1 was officially released, which introduced some new features such as Diffusion Probabilistic Models (DPM), MIDI and Metronome support, and Note-level cross-lingual synthesis. In addition, it was announced that Mai was released as a free vocal for all Synthesizer V Studio Pro users, with Dreamtonics cautioning that the 1.8.0b1 editor and later editions were necessary to use her voice database as she would not work with older versions. There was no expiration for her free distribution. Through an interview with DTM Station, Kanru Hua explained that Synthesizer V Studio Basic and Lite versions of certain voice databases were released so users could experience it for free with limited functions. On the other hand, upon purchasing Synthesizer V Studio Pro, there weren't options like this for full voice databases, leading to the free distribution of Mai so users could experience the fun and wonders of AI singing voice synthesis.

### 2023

Initially, Mai's voice provider was left anonymous until March 15, 2023, when it was announced that she was voiced by the Japanese singer-songwriter Honoka Kitta. According to an interview with DTM, Honoka Kitta confirmed that she was selected to be Mai's voice provider among a number of other candidates via an email from Dreamtonics. Although confused at first, she was interested in the project and agreed to record from home after discussing the recorded song materials and details through a remote meeting as she never met Kanru Hua and Tomohide Ogata in person prior to the interview. After sending the materials to Dreamtonics, the company returned feedback according to the recording effect and asked her to record again. She also mentioned that she was concerned that the AI voice database may take her job, thus her hesitation about revealing herself as the voice provider knowing that Mai sounded a lot like her.

### Updates

Mai AI v101b1 - April 18, 2023
A free update for Mai was released following the Synthesizer V Studio 1.9.0b1 update. This implemented the new rap feature available for the English and Mandarin languages. Cantonese Chinese was added to the Cross-lingual Singing Synthesis feature as well as general improvements to the overall function, resulting in more accurate pronunciation that sounds closer to a native speaker when singing foreign words.

Mai AI v101b2 - May 23, 2023
A free update for Mai was released following the Synthesizer V Studio 1.9.0b2 update. This version of the vocal allowed for compatibility with the engine's second beta, which focused on rectifying several design issues identified by the user base in the 1.9.0b1 post-release survey.

Mai AI v101 - June 21 2023
Final version update compatible for Synthesizer V Studio 1.9.0 and enables Mai to use the rap feature (English and Mandarin Chinese only) and allow for Cantonese Chinese Cross-lingual Singing Synthesis if the beta versions were not installed previously.

Mai AI v102b1 - August 2, 2023 A free update for Mai was released following the Synthesizer V Studio 1.10.0b1 update. This enhanced pitch generation by utilizing Reinforcement Learning from Human Feedback (RLHF), translating to fewer off-key errors, making better use of vibrato, and creating more expressive transitions between notes. This also allowed for the use of the new "Enhancement" slider in the AI Retakes panel, which controlled the level of changes introduced by RLHF. For Synthesizer V Studio Pro users, feedback submission was enabled, allowing users to consensually share their preferred takes with only Dreamtonics for research and development purposes, where models trained with this feedback would be deployed in future voice database updates. Users may also opt out of this feature if undesired.

Mai AI v102b2 - September 28, 2023 A free update for Mai was released following the Synthesizer V Studio 1.10.0b2 update, which was the second beta version following version 1.10.0b1 that introduced enhancements to voice databases and integrated the latest user feedback via Reinforcement Learning from Human Feedback (RLHF). Regarding the editor, numerous reported issues were addressed for a more fluid experience. A new generation of pitch models were trained using the extensive feedback from users over the past month, and the new models offered greater accuracy in voice timbre reproduction, as well as a reduction in mispronunciations. Dreamtonics also focused on issues from the previous beta release that made Vocal Modes seem less distinct on certain vocals, ensuring clearer differentiation in the 1.10.0b2 update. The latest update also introduced a new feature in the Note Properties Panel that allowed for even division of a note into multiple syllables, proving to be a useful tool for songs with faster tempos.

Mai AI v102 - October 19, 2023 Final version update compatible for Synthesizer V Studio 1.10.0 and enables Mai to use Reinforcement Learning from Human Feedback (RLHF) as well as other enhancements (as listed in v102b1 and v102b2's notes) if the beta version was not installed previously.

Mai AI v103 - October 26, 2023 A free update for Mai was released that added support for the Japanese language to the rap feature.

Mai AI v104b1 - December 18, 2023
A free update for Mai was released following the Synthesizer V Studio 1.11.0b2 update. This implemented support for the Spanish language in the Cross-Lingual Singing Synthesis feature.

## Voice Database Information

### Voice Databases

Product Information
**Optimum**

  **Genre:** Pop, J-Pop, Dance, Idol
**Versions**

  **Lite Version/FLT Available?:** No  **Starter Pack Available?:** No  **Web Version Available?:** No
**Package details** as noted:

Mai is a feminine Japanese voice database based on the singing style of Honoka Kitta. As expected of an AI voice database, this enables her to sing with a more human-like and realistic voice. She was marketed to promote the new functionalities and experiences of Synthesizer V Studio's 1.8.0's Diffusion Probabilistic Models (DPM) and Note-level cross-lingual synthesis.
**Vocal traits** as noted:

* Mai was said to have "crisp pop singing vocals" that was especially suitable for J-Pop, including Dance and Idol styles of music.
* Her basic character is retained in any range, allowing her to keep the "vibe of the song" undisturbed whenever she changes key.
* According to DTM Station, Mai has a very natural falsetto in her high range.
* With Diffusion Probabilistic Models (DPM), Mai can sing more realistically through changes in volume and breath, further enriching singing details, making each singing unique, and providing creators with more options. Through this mode, she can use AI Retakes to create multiple "takes" of a sung section to find an ideal vocal without the need for "laborious tuning". This feature is only available in the Synthesizer V Studio Pro Editor.

**Phonetic notes** as noted:

* Phoneme format: Romaji
* Through Cross-lingual Singing Synthesis, Mai can sing in not only Japanese but also in English and Mandarin Chinese. Since the release of her v101b1 update on April 18, 2023, she can also sing in Cantonese Chinese with this feature; since her v104b1 update on December 18, she can also sing in Spanish with this feature. Cross-lingual Singing Synthesis is only available in the Synthesizer V Studio Pro Editor.

**Vocal Modes** as noted (Synthesizer V Studio Pro Editor only):

* Mai comes with two variations:
	+ "Emotional"
	+ "Soft"

**System requirements** as noted:

* **OS**: Microsoft Windows 11 / 10 / 8.1 (32/64 bit); Mac OS X 10.11 (El Capitan) or higher, Ubuntu 18.04 or higher (64 bit)
* **CPU**: Intel Core i5 or higher (High-grade) or equivalent AMD processor
	+ When dealing with high-quality AI singing, it is recommended to use Intel Core 4th generation i5 (i5-4xxx) series or higher, or AMD Athlon X4 845 or higher, including Ryzen series
* **Memory**: 2GB or more
* **HDD**: 1 GB or more
* **Display resolution**: 1280 x 800 or higher

**License agreements** as noted:

* Dreamtonics Co., Ltd.'s End User License Agreement - Japanese
* Dreamtonics Co., Ltd.'s End User License Agreement - English
* Dreamtonics Co., Ltd.'s End User License Agreement - Simplified Chinese

**Voice database sample**

## References

1. ↑ https://twitter.com/dreamtonics\_en/status/1585542026648395776
2. ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0b1-update/
3. ↑ https://twitter.com/dreamtonics\_en/status/1590600959725830146
4. ↑ https://twitter.com/dreamtonics\_en/status/1590600966239571969
5. ↑ https://www.dtmstation.com/archives/58816.html
6. ↑ https://twitter.com/dreamtonics\_jp/status/1635899276810416129
7. ↑ https://www.dtmstation.com/archives/60410.html
8. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0b1-update-rap-cantonese-and-more/
9. ↑ https://twitter.com/dreamtonics\_en/status/1648235081608343552
10. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0b2-update/
11. ↑ https://twitter.com/dreamtonics\_en/status/1660888307482656771
12. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0-final-update/
13. ↑ https://twitter.com/dreamtonics\_en/status/1671427830629154816
14. ↑ https://twitter.com/dreamtonics\_en/status/1686648078571655168
15. ↑ https://t.bilibili.com/825177687051993121
16. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b1-update-enhancing-pitch-generation-with-user-feedback/
17. ↑ https://twitter.com/dreamtonics\_en/status/1707304150059639108
18. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b2-update/
19. ↑ https://twitter.com/ahsoft/status/1707304906535956719
20. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0-final-update/
21. ↑ https://twitter.com/ahsoft/status/1714919114182181140/photo/1
22. ↑ https://twitter.com/ahsoft/status/1717451110305366047
23. ↑ https://dreamtonics.com/synthesizer-v-studio-1-11-0b2-update/
24. ↑ https://www.dtmstation.com/archives/58686.html