Abstract:
An object storage system, such as a content addressed storage system, manages replication of objects across network locations to balance storage space and data security. Network locations set a policy of replicating each object at the object&#39;s primary network location and a secondary network location. The secondary network location creates a first replica of the object and a virtual unique identifier representing a second replica of the object at the secondary network location. Creation of the second replica is suppressed unless the first replica becomes invalid so that storage space is conserved without substantially increasing the risk of loss of information represented by the object.

Description:
BACKGROUND OF THE INVENTION 
       [0001]    1. Field of the Invention 
         [0002]    The present invention relates in general to the field of information handling system network storage, and more particularly to a system and method for managing replication in an object storage system. 
         [0003]    2. Description of the Related Art 
         [0004]    As the value and use of information continues to increase, individuals and businesses seek additional ways to process and store information. One option available to users is information handling systems. An information handling system generally processes, compiles, stores, and/or communicates information or data for business, personal, or other purposes thereby allowing users to take advantage of the value of the information. Because technology and information handling needs and requirements vary between different users or applications, information handling systems may also vary regarding what information is handled, how the information is handled, how much information is processed, stored, or communicated, and how quickly and efficiently the information may be processed, stored, or communicated. The variations in information handling systems allow for information handling systems to be general or configured for a specific user or specific use such as financial transaction processing, airline reservations, enterprise data storage, or global communications. In addition, information handling systems may include a variety of hardware and software components that may be configured to process, store, and communicate information and may include one or more computer systems, data storage systems, and networking systems. 
         [0005]    Large scale object storage systems, such as the DX6000 developed by Dell Inc., store information in a network “cloud” by using a universally unique identifier (UUID) token to store and retrieve the information. In order to prevent data loss, object storage systems may provide content replication between independent network locations, such as with many-to-many replication. In some instances, an application provides redundancy across network sites via multi-site writes, while in other cases, the storage subsystem provides redundancy across network sites by replicating objects at different network sites. Object storage systems protect against data loss by using RAID, RAIN or content replica-based policy storage to address data redundancy challenges at each network site location. With a content replica-based storage policy subsystem, a content addressed storage (CAS) policy typically replicates content based upon the UUID of the content and a cluster level policy that sets the number of replicas. For example, with a typical replica policy each cluster replicates each object at least twice at each independent network site. Creating redundant copies of the same object increases storage costs by eating up storage space, however, provides greater protection against potential data loss presented when only one copy is maintained. 
         [0006]    Although cluster storage advantageously improves data security and flexibility, one difficulty with content addressed storage in a “cloud” network environment is managing the number of replicas where storage of a particular object is not tied to a physical storage device. This allows content objects to be distributed and re-distributed to enable load balancing by assigning a UUID token for content object access to each object written to object storage. Having multiple replicas at each site of network storage adds significant costs since each independent site lacks a co-relation between an object copy of different sites once replication is completed. Hence, if different independent sites replicate content to each other with two or more copies at each site, the number of replicas grows exponentially increasing total storage requirements. By comparison, applications that have no binding between sites and have a replica count set at 1 for a site can experience a silent data loss. For example, if the application is keeping a single replica at a remote site and a storage system failure occurs that results in a lost or corrupted replica, the failure may go unnoticed until the application attempts to access the data. End users of a content addressed storage system face the difficult choice of reducing costs by having one replica per site and accepting the risk of data loss, or accepting increased costs by having multiple replicas of content at each site in order to reduce the risk of data loss. For example, in one common configuration, two copies of a content object are maintained at a source site directly accessed by an application with two copies at each replica site so that the number of replicas grows to exponentially increase required storage size for a given set of data. 
       SUMMARY OF THE INVENTION 
       [0007]    Therefore a need has arisen for a system and method which manages replication across the object storage system. 
         [0008]    In accordance with the present invention, a system and method are provided which substantially reduce the disadvantages and problems associated with previous methods and systems for replicating information stored in an object storage system. A virtual identifier indicates the presence of a replica at a network location to prevent replication of an object when existing replicas provide adequate data availability. The virtual identifier applies at the node storing the object but is transparent to an application or node that attempts to access an object associated with the virtual identifier because an application accessing an identifier does not know if the identifier has actual content or virtual content. If the virtual identifier is called to provide an object, such as when another replica at a network location has become invalid, a replica is created and provided in response to the request for the virtual identifier. 
         [0009]    More specifically, content addresses storage system stores objects at a network location by reference to a UUID unique identifier token. A publisher module at the network location publishes the object to a subscriber module of a distal network location so that the subscriber module creates a replica of the object at the distal network location to provide desired data redundancy. Network locations have a replica policy engine that calls for two or more copies of each object to be stored at each network location to prevent data loss, however, the replica policy engine intervenes to alter the replica policy if an object is itself a replica created as a redundant copy of an object at another network location. Instead of creating additional copies of an object sent for replication by a primary network location, the replica policy engine creates one replica at a secondary network location and “tricks” the secondary network location to believe that a second replica is created by reference to a virtual identifier. In the event that a replica object associated with a virtual identifier is called for retrieval, such as if the actual replica of the secondary network location becomes invalid, then the replica policy engine provides a high priority request for retrieval of the object from the primary network location to the secondary network location to create a replica for association with the virtual identifier. 
         [0010]    The present invention provides a number of important technical advantages. One example of an important technical advantage is that improved management of replicas in an object storage system provides protection from data loss with reduced storage space requirements. A content addressed storage system creates a virtual identifier that has the UUID but lacks an associated object and therefore uses minimal storage space. This scheme allows the creation of an actual object (UUID) and a pointer (virtual UUID) to the actual object irrespective of the location of the actual object at a local or remote site. Monitoring of original content associated with the virtual identifier allows a timely creation of an actual content object for association with the virtual identifier should original content become unavailable. Adjusting storage priorities to allow for rapid replication when failure is detected results in minimal impact on system performance. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0011]    The present invention may be better understood, and its numerous objects, features and advantages made apparent to those skilled in the art by referencing the accompanying drawings. The use of the same reference number throughout the several figures designates a like or similar element. 
           [0012]      FIG. 1  depicts a block diagram of an object storage system that manages replication of objects to adjust storage usage; 
           [0013]      FIG. 2  depicts a flow diagram of a process for creating a virtual identifier to indicate multiple replicas at a secondary network location; 
           [0014]      FIG. 3  depicts a flow diagram of a process of creating an object to associate with the virtual identifier if a virtual replica is called at a secondary network location; and 
           [0015]      FIG. 4  depicts a flow diagram of a process of creating an object to associate with the virtual identifier if an application requests a virtual replica from the secondary network location. 
       
    
    
     DETAILED DESCRIPTION 
       [0016]    Replicas in an object storage information handling system having plural network locations are managed by creating virtual object identifiers at one or more network locations and creating an associated content object upon retrieval of the virtual object identifier. For purposes of this disclosure, an information handling system may include any instrumentality or aggregate of instrumentalities operable to compute, classify, process, transmit, receive, retrieve, originate, switch, store, display, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, or other purposes. For example, an information handling system may be a personal computer, a network storage device, or any other suitable device and may vary in size, shape, performance, functionality, and price. The information handling system may include random access memory (RAM), one or more processing resources such as a central processing unit (CPU) or hardware or software control logic, ROM, and/or other types of nonvolatile memory. Additional components of the information handling system may include one or more disk drives, one or more network ports for communicating with external devices as well as various input and output (I/O) devices, such as a keyboard, a mouse, and a video display. The information handling system may also include one or more buses operable to transmit communications between the various hardware components. 
         [0017]    Referring now to  FIG. 1 , a block diagram depicts an object storage system that manages replication of objects to adjust storage usage. Content addressed storage system  10  provides storage through a network  12  at plural network locations  14 , such as a primary network location  16  accessed by an application  18  and a secondary network location  20  that provides redundancy for information stored at primary network location  18 . For instance, application  18  executing on a client information handling system interfaces through network  12 , such as the network, to communicate with primary network location  16 , such as a storage area network having a server information handling system  22  and plural storage devices  24 . Application  18  stores information on storage devices  24  by interacting through server information handling system  22 . Information generated by application  18  is stored as an object  26  on one or more storage devices  24  and is tracked as content with a UUID token. A replica policy engine  28  executing on a CPU  30  and RAM  32  of server information handling system  22  generates one or more replica objects  34  that are stored by reference to a UUID on storage devices  24  of primary network location  16 . By having a replica policy of 2 copies of each object on each primary network location, ready access to a redundant copy of the object is available in the event that the primary object becomes invalid. 
         [0018]    In addition to maintaining an object  26  and replica  34  at primary network location  16 , which is the source network location of application  18 , content addressed storage system  10  also maintains a copy of object  26  as a replica  34  on secondary network location  20 , which is remote to primary network location  16 . A publisher module  36  executing on CPU  30  at primary network location  16  publishes object  26  to a subscriber module  38  running on CPU  30  at secondary network location  20 . Replica policy engine  28  running on CPU  30  at secondary network location  20  detects publication by subscriber module  38  and manages the number of replica objects stored on secondary network location  20  according to a replica policy. For example, in order to conserve storage space replica policy engine  28  creates only one replica at secondary network location  20  when replica policy engine  28  detects that the replica supports a primary network location  16  that stores an object  26  and a replica  34 . In order to “trick” content addressed storage system  10  into the desired replica policy, replica policy engine  28  creates a replica  34  tracked by a UUID and also creates a virtual UUID  40  that indicates a second replica was created even though the second replica is not created at secondary network location  20 . Those of skill in the art will recognize that the term “virtual UUID” broadly references an indication of storage of an object that does not in fact exist, and may also be referenced as a virtual replica or similar term. The virtual UUID applies to the node that stores the virtual content, however, to other nodes or applications the virtual UUID appears as a valid UUID having associated content. The virtual nature of a UUID is transparent to applications and other nodes that want content associated with a UUID so that requests are made to the virtual UUID as if it is a standard UUID associated with the content. In operation, an HTTP request based upon content to a content addressed storage system returns a UUID token, which may be filled by any object having the UUID or an associated identifier to provide the content associated with the UUID. 
         [0019]    During normal operations, three copies of object  26  exist for access by application  18  through a request of a UUID associated with the object  26 . Application  18  is served by primary network location  16 , which provides object  26  or replica  34  in response to a request for the stored information with a UUID ticket. In the event that object  26  and replica  34  of primary network location  16  is not available, content addressed storage system  10  will respond to the UUID token by providing replica  34  of secondary network location  20  as a redundant object to primary network location  16 . Alternatively, application  18  can attempt to retrieve object  26  by making a request to secondary network location  20 . During the retrieval process, if a fault is detected with the object replica  34  stored at secondary network location  20 , replica policy engine  28  will attempt to generate a replica to associate with virtual UUID  40  so that secondary network location  20  can respond to the UUID with the virtual replica after creation of an actual replica object. 
         [0020]    Replica policy engine  28  runs at each network location node  14 ,  16  and  20  to check replication policy and data integrity for each UUID residing on each node. A replica policy engine  28  learns of replica objects on other network locations from UUID mapping or via bidding. If a replica policy engine  28  cannot access the object associated with a UUID and the replica policy calls for 1 replica at a distal network location, then replica policy engine  28  determines that the UUID without a content object is a virtual UUID  40 . If replica policy engine  28  detects that a UUID exists for a replica object but that no virtual UUID exists, then it bids out for a virtual UUID creation and the winning node bid stores the virtual UUID without a content object. As an example, this situation could arise if a replica is created to associate content with a virtual UUID in response to a request for content so that another virtual UUID is created after the replica is created. As an alternative example, an object with the actual UUID may be created so that the virtual UUID is left intact. If replica policy engine  28  detects that a virtual UUID exists but that no UUID exists, a high priority request is made to the source network location for the content object associated with the UUID to generate a replica at the secondary network location. If an application  18  requests content associated with a UUID from a secondary network location, the node with the virtual UUID  40  provides a lower priority response to the request than the node with the replica UUID  34  so that the node having an actual content object will win the bid to fill the request for the content object. If the replica UUID is not found or is not valid in response to the winning bid, then replica policy engine  28  initiates a high priority request to create a replica object associated with the virtual UUID  40  so that application  18 &#39;s request for the content object can be filled with a content object associated with the virtual UUID. 
         [0021]    Increased priority for a request to create a content object associated with a virtual UUID helps to limit delays for pending content requests. A “retry after timeout” error provided in response to a request for a content object indicates to the application  18  that only a virtual UUID was found and a delay will occur while the content object is retrieved from a source/publisher node to create a replica object associated with the virtual UUID. By the timeout time frame, the object from the source node is requested and another node within the subscriber network location stores the content and bids to fill the application request. 
         [0022]    Referring now to  FIG. 2 , a flow diagram depicts a process for creating a virtual identifier to indicate multiple replicas at a secondary network location, even though no replica object exists for the virtual identifier. The process starts at step  42  with storage of a content object at a primary network location of an object storage system, such as a content addressed storage system. At step  44 , the content object is replicated at the primary network location, such as another node within a cluster, so that a local redundant replica exists for the content object. At step  46 , the UUID of the content object is returned to the application host. This allows the application to retrieve the content object by submitting the UUID and receiving in response the primary object or the replica object from the primary network location. At step  48 , the content object is published via a multicast snoop or other mechanism to a secondary network location in accordance with a replication policy that has replicas created at distal network locations. At step  50 , a UUID list is obtained from the primary network location to coordinate a UUID for a replica of the object at the secondary network location. At step  52 , a subscribe module at the secondary network location replicates the object from the primary network location and assigns a UUID. The assigned UUID may be the same as that of the primary network location, a variant of the primary network location or otherwise associated with the UUID of the primary network location. At step  54 , a virtual copy of the replica is created at the secondary network location by association with a virtual UUID having the same value as the replicated object but no content. At step  56 , a successful replication of two copies of the content object is reported to the publisher along with the UUID. 
         [0023]    Referring now to  FIG. 3 , a flow diagram depicts a process of creating an object to associate with the virtual identifier if a virtual replica is called at a secondary network location. The term “virtual replica” applies to nodes that store information or objects but is transparent to applications that use objects because the applications do not know the difference between a virtual and non-virtual UUID, but rather see virtual UUIDs as normal content source. The process begins at step  58  with monitoring of a replica at a secondary network location to detect an invalid content object. If an invalid replica is detected, the process continues to step  60  to request a virtual copy represented by a virtual UUID. At step  62 , a request is made from the secondary network location to the primary network location for the content object associated with the virtual UUID. The request includes an indication of increased priority so that the content object is transferred in a more rapid manner relative to other requests for content objects. At step  64 , the UUID request is received by the publisher of the primary network location. At step  66 , the publisher of the primary network location initiates replication of the content object associated with the UUID from the primary network location to an object associated with the virtual UUID at the secondary network location. At step  68 , the subscriber of the secondary network location generates a content object for association with the virtual UUID. At step  70 , the subscriber of the secondary network location generates a virtual UUID to replace the virtual UUID that was just associated with a content object. 
         [0024]    Referring now to  FIG. 4 , a flow diagram depicts a process of creating an object to associate with the virtual identifier if an application requests a virtual replica from the secondary network location. The process begins at step  72  with a request for a content object by a UUID made from an application host. At step  74 , the secondary network location finds a virtual UUID associated with the request and lacking content. Such a situation might arise if the node supporting the virtual UUID underbids the node supporting a replica object, but the replica object is found invalid so that the virtual UUID must provide a content object that does not actually exist. At step  76 , the contend associated with the virtual UUID is requested from the replication policy engine of the secondary network location, which at step  78  sends a request for the content object to the publisher of the primary network location. At step  80 , the publisher retrieves the content object form the primary network location by reference to the UUID and, at step  82  sends the content object with the publisher of the primary network location to the subscriber of the secondary network location. At step  84 , the subscriber of the secondary network location replicates the object at the secondary network location is association the virtual UUID of the secondary network location. At step  86 , the newly replicated object associated with the virtual UUID is provided to the application host in response to the request for the object from the secondary network location with the UUID. At step  88 , a new virtual UUID is generated at the secondary network location to provide a redundant copy object for the newly generated replica object formerly associated with a virtual UUID. 
         [0025]    Although the present invention has been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the invention as defined by the appended claims.