Patent ID: 11940923
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 15:
16. A system, comprising:
at least one processor; and
at least one memory device including a data store to store data elements and instructions that, when executed, cause the system to:
store a plurality of cache entries at different levels of a multi-level cache stored in a computer memory, wherein individual ones of the cache entries include respective computed data and a respective plurality of cost measures of different cost types, wherein for the individual one of the cache entries, respective ones of the cost measures of the different cost types represent respective different computing costs for respective different types of resources to re-compute the computed data for the respective cache entries;
record respective frequencies at which respective individual cache entries are accessed;
receive a message with an incoming cache entry to add to the cache, wherein the incoming cache entry comprises a respective plurality of cost measures of the different cost types for the incoming cache entry;
identify an eviction cache entry which has a lower total cost, which is computed based on one or more of the respective cost measures combined with the respective frequency of access, as compared to the total cost for other cache entries in a particular level of the multi-level cache, in order to evict the eviction cache entry from the particular level;
remove the eviction cache entry determined to be evicted from the particular level of the multi-level cache, wherein an entry corresponding to the eviction cache entry is added to or remains in a higher level of the multi-level cache than the particular level; and
write the incoming cache entry, including the respective plurality of cost measures for the incoming cache entry, into the particular level of the multi-level cache stored in the computer memory.