Patent ID: 11908447
Assignee: IUCF-HYU (INDUSTRY-UNIVERSITY COOPERATION FOUNDATION HANYANG UNIVERSITY)
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. An apparatus for synthesizing multi-speaker speech using an artificial neural network, comprising:
a communicator configured to receive, from an external server, information on a speech learning model for a plurality of users by subjecting a synthetic artificial neural network of a speech synthesis model to learning, based on speech data of the plurality of users;
a storage configured to store information on the speech learning model generated;
a speaker vector generator configured to generate speaker vectors for a new user who has not been learned and the plurality of users who have already been learned by using a speaker recognition model; and
a similar-vector determinator configured to determine a speaker vector having a most similar relationship with the speaker vector of the new user according to preset criteria out of the speaker vectors of the plurality of users who have already been learned; and
a speech synthesizer configured to generate and learn a speaker embedding of the new user by subjecting the synthetic artificial neural network of the speech synthesis model to learning, by using a value of a speaker embedding of a user for the determined speaker vector as an initial value and based on speaker data of the new user,
wherein the speech synthesizer is configured to perform the learning of the synthetic artificial neural network of the speech synthesis model only for a preset time that prevents overfitting,
wherein the preset time comprises a range of 10 seconds to 60 seconds, and
wherein the speaker vector generator is configured to generate the speaker vectors using an artificial neural network of the speaker recognition model, by using a speech signal of the user as an input value.