Patent ID: 11868344
Assignee: TENCENT AMERICA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for cross-lingual text-to-SQL semantic parsing, performed by at least one processor and comprising:
initializing target language models and train the target language models with target language data;
generating a contextual representation of a source language utterances, a target language utterances, and a database schema;
generating a mixed representation of the target language utterances and the database schema based on the contextual representation of the source language utterances, the target language utterances, and the database schema;
concatenating the mixed representation of the target language utterances and the database schema;
encoding the concatenated mixed representation of the target language utterances and the database schema, based on k-layer transformers; and
generating SQL queries token-by-token based on the encoded concatenated mixed representation of the target language utterances and the database schema;
generating mixed representations of the target language utterances and the database schema comprises:
applying self-attention to the source language utterances independently and the target language utterances independently in a first layer of a transformer to generate the mixed representation of the target language utterances;
sharing parameters from a second layer of the transformer to the first layer of the transformer;
enhancing the mixed representations of the target language utterances based on a mixup ratio of the second layer of the transformer;
and applying a skip connection to the database schema to generate the mixed representation of the database schema.