Patent ID: 11892998
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A computer-implemented method for performing efficient embedding table storage and lookup in machine-learning models, comprising:
obtaining, by one or more processors, an embedding table associated with a machine-learning model, the embedding table comprising a plurality of individually compressed embeddings allowing each respective embedding to be decompressed independent of any other embedding in the embedding table;
receiving, by the one or more processors, an input to use for locating an embedding in the embedding table;
determining, by the one or more processors, a lookup value based on the input for searching indexes of the embedding table to locate the embedding;
locating, by the one or more processors, the embedding based on searching the indexes of the embedding table for the determined lookup value; and
decompressing, by the one or more processors, the embedding independent of any other embedding in the embedding table in view of the locating.