Patent ID: 11940923
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 20:
21. A method, using one or more processors, comprising:
receiving an incoming cache entry that includes computed data and a cost measure to add to a cache of a plurality of cache entries in a computer memory, wherein respective ones of the cache entries store respective computed data and a respective cost measure that represents a computing cost to generate the computed data stored in the cache, and wherein individual cache entries have a respective time to live (TTL);
responsive to receiving the incoming cache entry, identifying a cache entry to be evicted from the cache to make room in the cache for the incoming cache entry, comprising:
determining that none of the cache entries has a respective TTL that is expired; and
responsive to the determination that none of the cache entries has a respective TTL that is expired, identifying the cache entry to be evicted that has a lower respective stored cost measure than the respective stored cost measure for other cache entries; and

replacing the identified cache entry to be evicted from the cache with the incoming cache entry.