Patent ID: 11868344
Assignee: TENCENT AMERICA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. An apparatus for cross-lingual text-to-SQL semantic parsing, the apparatus comprising:
at least one memory configured to store computer program code; and
at least one processor configured to read the computer program code and operate as instructed by the computer program code, the computer program code including:
initializing code configured to cause the at least one processor to target language models and train the target language models with target language data;
generating code configured to cause the at least one processor to generate a contextual representation of a source language utterances, a target language utterances, and a database schema;
mixup code configured to cause the at least one processor to generate a mixed representation of the target language utterances and the database schema based on the contextual representation of the source language utterances, the target language utterances, and the database schema;
first concatenating code configured to cause the at least one processor to concatenate the mixed representation of the target language utterances and the database schema;
first encoding code configured to cause the at least one processor to encode the concatenated mixed representation of the target language utterances and the database schema, based on k-layer transformers; and
SQL generating code configured to cause the at least one processor to generate SQL queries token-by-token based on the encoded concatenated mixed representation of the target language utterances and the database schema;
representation generating code configured to cause the at least one processor to generate mixed representations of the target language utterances and the database schema comprises:
applying self-attention to the source language utterances independently and the target language utterances independently in a first layer of a transformer to generate the mixed representation of the target language utterances;
sharing parameters from a second layer of the transformer to the first layer of the transformer;
enhancing the mixed representations of the target language utterances based on a mixup ratio of the second layer of the transformer;
and applying a skip connection to the database schema to generate the mixed representation of the database schema.