Weina (Synthesizer V Studio)

* Digital (Taobao)
* (Dreamtonics Intl.)

* Dreamtonics (International)
* Dreamtonics (Intl.) (Bundle Set)
* Dreamtonics (Mainland China)
* Dreamtonics (Mainland China) (Bundle Set)

**This article is about the Synthesizer V Studio software known as a voice database. If you are looking for the Synthesizer V concept then click here.**

## History

On June 15, 2022, Dreamtonics posted a small poem on bilibili along with an announcement that news was expected for June 17 at 17:00 GMT+8. The project was not specified but was noted to be an introduction to a new era, allowing users to witness the collision of art and technology, and letting beauty come in a new form. The Synthesizer V AI Gold series was then introduced on June 17, with the first vocalist, Weina, to be released in July. Recording and production were being conducted at Ready Steady Sound! and Sound & Vision Media Studio respectively, with both companies being previously involved with Mo Chen's demo song "Zhè Gǎnjué". Weina was created under the close guidance of Weina Hu, a renowned Chinese vocalist. Weina's illustration was revealed at the end of her concept trailer, but no demos were available at the time. Kanru Hua later tweeted that English songs were also being sampled for Weina. When asked if Weina Hu was the voice provider of the library, she confirmed in the comments of the bilibili concept video that she was. This was later backed by an announcement on Dreamtonics's Japanese Twitter account. Dreamtonics also tweeted that Weina would be released on both their Taobao store and international store.

On July 5, Weina Hu posted that the voice database was coming soon. On July 9, it was announced that pre-orders for Weina on Taobao and WeChat were made available and that she would be released on July 21, which was when she would be stocked on the Dreamtonics International Store as it was confirmed it would not be participating in the pre-sale promotions. During the pre-order period, she was to be sold at a discounted price of 799 yuan as a standalone and 1079.1 yuan as a bundle pack with the Synthesizer V Studio editor.

On July 16, Dreamtonics released an interview video featuring Weina Hu, which covered her reflections on the relationships between synthetic vocals, music composition, and live singers. When asked about the opportunity to cooperate with Dreamtonics, Weina Hu revealed that she was able to participate in the project through Song Tianxiang's introduction, who was the producer for "Zhè Gǎnjué", and the art director and demo producer for the Weina product. Prior to officially participating, Weina Hu first listened to a sample of AI singing songs, which shocked her and prompted her to joke about her worries about being unemployed. However, in an era when AI became involved in all aspects of social and cultural creation, Weina Hu believed that if AI technology had reached such a high level, it could still improve the work efficiency and quality of all music creators, thus she embraced the innovative technology and took the job. When asked about how to treat singing synthesis technology from the perspective of musicians and singers, she replied that an important process of vocal music creation was to grasp the singing and expression of songs through demoing. If AI singing voices, like Synthesizer V, can provide musicians with a high-quality and efficient demo creation experience, then real singers can learn the singing details of songs faster. For many singers, the first impression that a demo brings to them was especially important because they would unconsciously rely on the first impression in subsequent performances. When asked about choosing between uniqueness and plasticity in singing, Weina Hu responded that in her extensive work as a chorus vocalist, singing demos for singers, and singing and dubbing songs for animations, she needed to show strong plasticity to adapt to the needs and changes of different clients. However, as a singer, she needed to show her unique charm. Thus, the distinct roles and various positions of participating in music determined the distinctive characteristics that the singing needed to show. Further episodes from Dreamtonics were expected to release in the future.

Weina was released on July 21 as intended. According to her international store product page and categorizations on both the international and Taobao stores, she was noted to be a bilingual vocal in Mandarin Chinese and English.

On July 30, a second interview video with Weina Hu, which covered her perceptions of song interpretation, singer expression, and songwriter identity, was released. When asked whether vocal technique or emotional restoration was more important in vocal database production, she answered that both were mutually reinforcing relationships. To her, if there was not enough technique to support the song, the emotion of the song would not be fully expressed. However, in terms of the song style, if the accompaniment was light and the style was lyrical, then the singer would have more room to express their emotions and have more play in the breath. In this condition, emotion was more important than technique. If the accompaniment of the song was richly orchestrated, the range was wide and the voice required more tension, then the singer needed to use technique to meet the requirements of the song. The accompaniment already had much of the complement, so the need for emotional expression was not as strong. Not only was it important to observe the style and requirements of the piece, but focusing on the roles that technique and emotion played in supporting each other was also crucial and they simply could not be split up. When asked about memorable events during the collaboration in producing the Weina voice database, Weina Hu noted that the biggest difficulty in the process was the inconvenience of the COVID-19 pandemic and the resulting control factors. She was once stranded due to pandemic control and returned to Beijing only a month after the recording began. Her voice was greatly affected by her ill health and it took a long time to recover her vocal quality, which provided the strongest foundation for recording and directing the songs. By the time she regained her health and was able to work, the rest of the staff was isolated again due to the pandemic. It was the combined efforts of all parties which led to the realization of the product. When asked about what was different about this collaboration compared to previous works, she said that many of her past jobs were service-oriented such as harmonizing, vocal coaching, and supervising vocals. It was important to serve the voice that needed to be presented and there was not much room for her personal style to shine. For this project, not only did it require her to show her past singing experience but to also fully express her singing characteristics in different frequency bands in addition to showing her vocal range and power as much as possible so that the end product would become the material or basis for all future musicians to carry out their creative works. Such a goal and vision brought her an unprecedented sense of responsibility and feeling of apprehension, hoping to present a high-quality vocal database to creators and to continue her long-standing dedication to the cause to serve all music creation, regardless if it was backing vocals and demonstrations while rarely showed on stage.

### Updates

Weina AI v104b1 - November 10, 2022
A free update for Weina was released following the Synthesizer V Studio 1.8.0b1 update. This enables her to use the new Diffusion Probabilistic Models (DPM) feature.

Weina AI v104 - November 24, 2022
Final version update compatible for Synthesizer V Studio 1.8.0 and enables Weina to use the new Diffusion Probabilistic Models (DPM) feature if the beta version was not installed previously.

Weina AI v105b1 - April 18, 2023
A free update for Weina was released following the Synthesizer V Studio 1.9.0b1 update. This implemented the new rap feature available for the English and Mandarin languages. Cantonese Chinese was added to the Cross-lingual Singing Synthesis feature as well as general improvements to the overall function, resulting in more accurate pronunciation that sounds closer to a native speaker when singing foreign words.

Weina AI v105b2 - May 23, 2023
A free update for Weina was released following the Synthesizer V Studio 1.9.0b2 update. This version of the vocal allowed for compatibility with the engine's second beta, which focused on rectifying several design issues identified by the user base in the 1.9.0b1 post-release survey.

Weina AI v105 - June 21 2023
Final version update compatible for Synthesizer V Studio 1.9.0 and enables Weina to use the rap feature (English and Mandarin Chinese only) and allow for Cantonese Chinese Cross-lingual Singing Synthesis if the beta versions were not installed previously.

Weina AI v106b1 - August 2, 2023 A free update for Weina was released following the Synthesizer V Studio 1.10.0b1 update. This enhanced pitch generation by utilizing Reinforcement Learning from Human Feedback (RLHF), translating to fewer off-key errors, making better use of vibrato, and creating more expressive transitions between notes. This also allowed for the use of the new "Enhancement" slider in the AI Retakes panel, which controlled the level of changes introduced by RLHF. For Synthesizer V Studio Pro users, feedback submission was enabled, allowing users to consensually share their preferred takes with only Dreamtonics for research and development purposes, where models trained with this feedback would be deployed in future voice database updates. Users may also opt out of this feature if undesired.

Weina AI v106b2 - September 28, 2023 A free update for Weina was released following the Synthesizer V Studio 1.10.0b2 update, which was the second beta version following version 1.10.0b1 that introduced enhancements to voice databases and integrated the latest user feedback via Reinforcement Learning from Human Feedback (RLHF). Regarding the editor, numerous reported issues were addressed for a more fluid experience. A new generation of pitch models were trained using the extensive feedback from users over the past month, and the new models offered greater accuracy in voice timbre reproduction, as well as a reduction in mispronunciations. Dreamtonics also focused on issues from the previous beta release that made Vocal Modes seem less distinct on certain vocals, ensuring clearer differentiation in the 1.10.0b2 update. The latest update also introduced a new feature in the Note Properties Panel that allowed for even division of a note into multiple syllables, proving to be a useful tool for songs with faster tempos.

Weina AI v106 - October 19, 2023 Final version update compatible for Synthesizer V Studio 1.10.0 and enables Weina to use Reinforcement Learning from Human Feedback (RLHF) as well as other enhancements (as listed in v106b1 and v106b2's notes) if the beta version was not installed previously.

Weina AI v107 - October 26, 2023 A free update for Weina was released that added support for the Japanese language to the rap feature.

Weina AI v108b1 - December 18, 2023
A free update for Weina was released following the Synthesizer V Studio 1.11.0b2 update. This implemented support for the Spanish language in the Cross-Lingual Singing Synthesis feature.

## Voice Database Information

### Voice Databases

Product Information
**Versions**

  **Lite Version/FLT Available?:** No  **Starter Pack Available?:** Yes  **Web Version Available?:** No
**Package details** as noted:

Weina is a feminine Mandarin Chinese and English voice database based on the singing style of Weina Hu. As expected of an AI voice database, this enables her to sing with a more human-like and realistic voice. As part of the Synthesizer V AI Gold series, she represented the highest standard of production and was a model product for professional musicians to demonstrate AI's ultimate sound quality. She was marketed to promote the new functionality and experience of Synthesizer V Studio's 1.7.0's High Dynamics Voice Model (HDVM).
**Vocal traits** as noted:

* Weina was described to have a mature and reliable voice with a mezzo-soprano base.
* Her voice was considered full, rich, and powerful, reaching maturity.
* She was noted to be flexible as she could switch freely between different singing styles, from soulful lead singing, an explosive chorus, a rhythmic accompaniment, or a jubilant humming. She showed a wide range of adaptability and potential high-pitch performance in the mid-bass field.
* With HDVM, which later migrated to Diffusion Probabilistic Models (DPM) per the 1.8.0b1 update on November 10, 2022, Weina can sing more realistically through changes in volume and breath, further enriching singing details, making each singing unique, and providing creators with more options. Through this mode, Weina can use AI Retakes to create multiple "takes" of a sung section to find an ideal vocal without the need for "laborious tuning". This feature is only available in the Synthesizer V Studio Pro Editor.

**Phonetic notes** as noted:

* Through Cross-lingual Singing Synthesis, Weina can sing in not only Mandarin Chinese and English but also Japanese. Since the release of her v105b1 update on April 18, 2023, she can also sing in Cantonese Chinese with this feature; since her v108b1 update on December 18, she can also sing in Spanish with this feature. Cross-lingual Singing Synthesis is only available in the Synthesizer V Studio Pro Editor.
	+ It should be noted that while Dreamtonics officially recognizes Weina as a bilingual voice database, her default language is set to Mandarin Chinese. She was confirmed to be trained with a carefully curated selection of Mandarin Chinese and English songs which helped her pronunciations in both languages. She would only be available as a Mandarin Chinese voice database by default in the Synthesizer V Studio Basic Editor.

**Vocal Modes** as noted (Synthesizer V Studio Pro Editor only):

* Weina comes with seven variations:
	+ "Delicate"
	+ "Tender"
	+ "Lucid"
	+ "Firm"
	+ "Powerful"
	+ "Resonant"
	+ "Warm"

**System requirements** as noted:

* **OS**: Microsoft Windows 11 / 10 / 8.1 (64 bit) and up; macOS 10.11 (El Capitan) and up; Ubuntu 20.04 (64 bit) and up
* **CPU**: Intel Core i5 or higher, or equivalent AMD processor.
	+ For high-quality editing of AI audio: Intel Core series 4th generation i5 or higher is recommended, or AMD Athlon X4 845 or higher, including Ryzen series.
* **Memory**: 2GB or more.
* **HDD**: 1 GB or more
* **Display resolution**: 1280 x 800 or higher resolution
* **Others**: audio device, internet connection

**License agreements** as noted:

* Dreamtonics Co., Ltd.'s End User License Agreement - Japanese
* Dreamtonics Co., Ltd.'s End User License Agreement - English
* Dreamtonics Co., Ltd.'s End User License Agreement - Simplified Chinese

**Voice database sample**

## References

1. ↑ https://t.bilibili.com/671927052108038241
2. ↑ https://www.youtube.com/watch?v=fk3NKp3pHAw
3. ↑ https://twitter.com/khuasw/status/1537724493900443649
4. ↑ https://www.bilibili.com/video/BV1mL4y1N7wQ
5. ↑ https://cdn.discordapp.com/attachments/695380056943493280/987710328563433502/unknown.png - Screenshot as of June 18, 2022
6. ↑ https://cdn.discordapp.com/attachments/695380056943493280/987710328781565952/unknown.png - Screenshot as of June 18, 2022
7. ↑ https://twitter.com/dreamtonics\_jp/status/1539601812335955970
8. ↑ https://twitter.com/dreamtonics\_jp/status/1539601814126940161
9. ↑ https://t.bilibili.com/679442295616962561
10. ↑ https://t.bilibili.com/680848802961162241
11. ↑ https://www.bilibili.com/video/BV19t4y147kd
12. ↑ https://twitter.com/LenKiMo/status/1548242631343640577 - Summarized thread of Weina Hu's Interview by @LenKiMo
13. ↑ https://www.bilibili.com/read/cv17680155
14. ↑ https://www.bilibili.com/video/av386377012
15. ↑ https://twitter.com/LenKiMo/status/1553307746757652480 - Summarized thread of Weina Hu's second interview video by @LenKiMo
16. ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0b1-update/
17. ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/
18. ↑ https://twitter.com/ahsoft/status/1595674717200916481/
19. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0b1-update-rap-cantonese-and-more/
20. ↑ https://twitter.com/dreamtonics\_en/status/1648235081608343552
21. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0b2-update/
22. ↑ https://twitter.com/dreamtonics\_en/status/1660888307482656771
23. ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0-final-update/
24. ↑ https://twitter.com/dreamtonics\_en/status/1671427830629154816
25. ↑ https://twitter.com/dreamtonics\_en/status/1686648078571655168
26. ↑ https://t.bilibili.com/825177687051993121
27. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b1-update-enhancing-pitch-generation-with-user-feedback/
28. ↑ https://twitter.com/dreamtonics\_en/status/1707304150059639108
29. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b2-update/
30. ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0-final-update/
31. ↑ https://dreamtonics.com/synthesizer-v-studio-1-11-0b2-update/
32. ↑ https://space.bilibili.com/593592382/favlist?fid=1655788882 - These songs were featured in an official bilibili playlist featuring demos and recommended songs. Certain users were invited to create songs using earlier versions of the voice database and release the songs in sequence after the product's release as a complement to official demo tracks. Although this did not apply to Weina when she first released, she may be present as a main vocalist in examples featuring the other Dreamtonics products, which would be added to this demo table. It should also be noted that certain songs may not be involved with the early invitation and were added based on the company's preference.
33. ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/
34. ↑ https://twitter.com/dreamtonics\_en/status/1550048543624564736
35. ↑ https://twitter.com/dreamtonics\_en/status/1550048543624564736