Patent ID: 9594752
Date: 2017-03-14
CPC Classifications: G06F,H04L,H04N,Y10S

Claim:
1. A network service system with off-heap caching comprising: a plurality of application servers, where each of the application servers runs an application server process (ASP) having ASP buffers and an ASP virtual memory space with ASP heap memory and ASP off-heap memory; a plurality of cache servers, where each of the cache servers runs a cache server process (CSP) having CSP indices and a cache constructor process (CCP) which is in communication with said CSP process, wherein for each of the cache servers said CCP process has a CCP virtual memory space with CCP heap memory and CCP off-heap memory, wherein for each of the cache servers said CSP process provides access to copies of CCP buffers stored in said CCP off-heap memory and to said CSP indices, wherein each of said ASP and each of said CSP communicate with a request and a response; a database server coupled to said plurality of cache servers which can provide data to be stored in said CCP off-heap memory of the plurality of cache servers; and a local area network (LAN) router coupling said plurality of application servers to said plurality of cache servers such that an ASP process of the plurality of application servers can store said copies of CCP buffers in said ASP off-heap memory and can use a key index to access said ASP buffers, wherein said LAN operates with an HTTP protocol; a wide area network (WAN) router coupling said plurality of application servers to the Internet, wherein said WAN router includes a load balancer to provide an initial introduction to an application server of said plurality of application servers; wherein said LAN router includes a load balancer to provide an initial introduction between an application server of said plurality of application servers and a cache server of said plurality of cache servers; wherein said key index is stored in said ASP heap memory of each of the plurality of application servers.