Patent ID: 11869467
Assignee: SONY GROUP CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 3:
4. An information processing method performed by a computing device, the method comprising:
receiving a user input identifying a feature of a first audio content to be replaced by a feature of a second audio content different from the first audio content;
processing the first and second audio content with an optimized first and second learned model, respectively;
wherein the optimized first learned model generates:
a first vector of the first audio content that represents the first audio content without the feature of the first audio content, and
a second vector of the first audio content that represents the identified feature of the first audio content;

wherein the optimized second learned model generates:
a first vector of the second audio content that represents the second audio content without the feature of the second audio content, and
a second vector of the second audio content that represents the feature of the second audio content;

generating a third audio content by merging the first vector of the first audio content with the second vector of the second audio content,
wherein the second vector of the first audio content and the second vector of the second audio content have equal dimensions,
wherein the optimized first learned model is generated by:
using an initial first learned model to:
perform an extraction process on the first audio content to separate the feature of the first audio content from a remainder of the first audio content corresponding to the first audio content without the feature of the first audio content,
encode the remainder of the first audio content with a first encoder, and encode the feature of the first audio content with a second encoder,
output the encoded remainder of the first audio content and the encoded feature of the first audio content to a common decoder to reconstitute the first audio content, and
output the reconstituted first audio content which comprises the decoded remainder of the first audio content and the decoded feature of the first audio content,

adjusting a parameter of at least one of the first encoder, second encoder or decoder to reduce a difference between the first audio content and the reconstituted first audio content,
updating the initial first learned model based on the adjusted parameter to create the optimized first learned model, and
storing the optimized first learned model,

wherein the optimized second learned model is generated by:
using an initial second learned model to:
perform an extraction process on the second audio content to separate the feature of the second audio content from a remainder of the second audio content corresponding to the second audio content without the feature of the second audio content,
encode the remainder of the second audio content with the first encoder, and encode the feature of the second audio content with the second encoder,
output the encoded remainder of the second audio content and the encoded feature of the second audio content to the common decoder to reconstitute the second audio content, and
output the reconstituted second audio content which comprises the decoded remainder of the second audio content and the decoded feature of the second audio content,

adjusting a parameter of at least one of the first encoder, second encoder or decoder to reduce a difference between the second audio content and the reconstituted second audio content,
updating the initial second learned model based on the adjusted parameter to form the optimized second learned model, and
storing the optimized second learned model.