Patent ID: 11941035
Assignee: BOE TECHNOLOGY GROUP CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 2:
3. An electronic device, comprising: a processor and a memory, wherein the processor is configured to execute a program stored on the memory to implement:
obtaining a first vector set, wherein vectors in the first vector set are absolute position embeddings vector of a BERT model;
generating a second vector set based on the first vector set, wherein the number of vectors in the second vector set is greater than the number of the vectors in the first vector set, and each vector in the second vector set is determined according to one or more vectors in the first vector set; and
taking the vectors included in the first vector set and the vectors included in the second vector set as input encoding vectors to perform model training to obtain a summary generation model, wherein the summary generation model is a neural network model with vectors of a text as input encoding vectors and a summary of the text as an output, wherein the first vector set includes N vectors, and the second vector set includes N*N vectors, and N a positive integer greater than 1,, wherein the generating a second vector set based on the first vector set, includes:
determining the second vector set with the following formula:

qi×n+j=αp(Imax+1−i)+(1−α)pj,, wherein qi×n+j is a vector in the second vector set, p(Imax+1−i) and pj are vectors in the first vector set, Imax is a maximum position number value of the absolute position embeddings vectors of the BERT model, α is a preset coefficient, 0<α<1, and α is not equal to 0.5.