Patent ID: 11941522
Assignee: ZHEJIANG UNIVERSITY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 4:
5. The address information feature extraction method based on a deep neural network model according to claim 4, wherein in the step S42, the natural language training program based on the random masking strategy specifically comprises:
randomly masking some characters in the sentence of the input address text, and representing by masking symbols; then replacing a part of the masking symbols in the address text sentence with real characters, replacing another part of the masking symbols in the address text sentence with wrong characters, and keeping the rest of the masking symbols unchanged; in the training process of the Chinese addresses language model, the target task module being only executed on the three kinds of characters replaced by the masking symbols;
wherein in the neural network optimizer, three gradient update optimization strategies, which are learning rate decay, clip by global norm, and adaptive moment estimation, are adopted.