Patent ID: 11892998
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 6:
7. A computing system for performing efficient embedding table storage and lookup in machine-learning models:
one or more processors; and
one or more non-transitory computer-readable media that collectively store:
a machine-learned model configured to receive model input and process the model input to generate model output, wherein the machine-learned model comprises an embedding table comprising individually compressed embeddings allowing each respective embedding to be decompressed independent of any other embedding in the embedding table, and wherein the machine-learned model is configured to perform operations comprising:
obtaining the model input for processing in view of the embedding table;
determining a lookup value based on the model input for searching indexes of the embedding table to locate an embedding;
locating the embedding based on searching the indexes of the embedding table for the determined lookup value; and
decompressing, by the one or more processors, the embedding independent of any other embedding in the embedding table in view of the locating.