Source: https://patents.google.com/patent/US10001923B2/en
Timestamp: 2019-04-26 12:59:51
Document Index: 180897835

Matched Legal Cases: ['§ 120', '§ 119', 'Application No. 62', '§ 120', '§ 119', 'Application No. 61']

US10001923B2 - Generation collapse - Google Patents
Generation collapse Download PDF
US10001923B2
US10001923B2 US15/448,148 US201715448148A US10001923B2 US 10001923 B2 US10001923 B2 US 10001923B2 US 201715448148 A US201715448148 A US 201715448148A US 10001923 B2 US10001923 B2 US 10001923B2
US15/448,148
US20170177228A1 (en
2015-04-30 Priority to US201562154867P priority
2016-02-29 Priority to US15/056,517 priority patent/US9727266B2/en
2017-03-02 Application filed by International Business Machines Corp filed Critical International Business Machines Corp
2017-03-02 Priority to US15/448,148 priority patent/US10001923B2/en
2017-03-02 Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION reassignment INTERNATIONAL BUSINESS MACHINES CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BAPTIST, ANDREW D., MOTWANI, MANISH, RESCH, JASON K.
2017-06-22 Publication of US20170177228A1 publication Critical patent/US20170177228A1/en
2018-06-19 Publication of US10001923B2 publication Critical patent/US10001923B2/en
A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module that is configured to perform various operations. The computing device determines and converts sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs. The computing device convert a first storage generation set of EDSs associated with the data object to pre-establish DAP scoring information. Then, for additional generation sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs, the computing device uses additional DAP scoring information to determine migration of EDSs from the generation-based storage pool set of SUs to the DAP-based storage pool set of SUs.
The present U.S. Utility Patent Application also claims priority pursuant to 35 U.S.C. § 120, as a continuation-in-part (CIP) of U.S. Utility patent application Ser. No. 15/056,517, entitled “SELECTING STORAGE UNITS IN A DISPERSED STORAGE NETWORK,” filed Feb. 29, 2016, which claims priority pursuant to 35 U.S.C. § 119(e) to U.S. Provisional Application No. 62/154,867, entitled “AUTHORIZING A SLICE ACCESS REQUEST IN A DISPERSED STORAGE NETWORK,” filed Apr. 30, 2015, the U.S. Utility patent application Ser. No. 15/056,517 also claims priority pursuant to 35 U.S.C. § 120, as a continuation-in-part (CIP) of U.S. Utility patent application Ser. No. 12/903,212, entitled “DIGITAL CONTENT RETRIEVAL UTILIZING DISPERSED STORAGE,” filed Oct. 13, 2010, now issued as U.S. Pat. No. 9,462,316 on Oct. 4, 2016, which claims priority pursuant to 35 U.S.C. § 119(e) to U.S. Provisional Application No. 61/290,632, entitled “DIGITAL CONTENT DISTRIBUTED STORAGE,” filed Dec. 29, 2009, all of which are hereby incorporated herein by reference in their entirety and made part of the present U.S. Utility Patent Application for all purposes.
Data storage systems may be implemented in various ways, and data therein can be stored in various ways. The prior art does not provide an adequate means by which data may be migrated between various types of data storage systems in many cases. There continues to be a need for improvement in the manner by which data may be migration within and among various data storage systems.
FIG. 16A is a flowchart illustrating an example of modifying a data access approach for stored data in accordance with the present invention; and
FIG. 16B is a diagram illustrating an embodiment of a method for execution by one or more computing devices in accordance with the present invention.
A dispersed or distributed storage network (DSN) module includes a plurality of distributed storage and/or task (DST) execution units 36 (e.g., storage units (SUs), computing devices, etc.) that may be located at geographically different sites (e.g., one in Chicago, one in Milwaukee, etc.). Each of the DST execution units is operable to store dispersed error encoded data and/or to execute, in a distributed manner, one or more tasks on data. The tasks may be a simple function (e.g., a mathematical function, a logic function, an identify function, a find function, a search engine function, a replace function, etc.), a complex function (e.g., compression, human and/or computer language translation, text-to-voice conversion, voice-to-text conversion, etc.), multiple simple and/or complex functions, one or more algorithms, one or more applications, etc.
FIG. 15 is a schematic block diagram of another embodiment of a dispersed storage network (DSN) that includes a legacy storage pool set 1510 (e.g., a generation-based storage pool set), the network 24 of FIG. 1, a migration unit 1530, and a new storage pool set 1520 (e.g., a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set). Note that the migration unit 1530 may be implemented as a computing device 12 or 16 such as described herein and/or any other type of device such as a SU long SU of the legacy storage pool set 1510 or the new storage pool set 1520, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, a video game device, and/or any other type of device. The legacy storage pool set 1510 includes a plurality of storage generations (e.g., storage generation 0-G), where each storage generation includes a set of storage units (SUs) units 1-n. The new storage pool set 1520 includes a plurality of SU pools 1-P, where each SU pool includes a set of SUs 1-n. Each SU may be implemented utilizing the SU 36 of FIG. 1. Hereafter, a SU may be referred to as a storage unit and a SU pool and be referred to as a storage pool. The migration unit 1530 may be implemented utilizing one or more of the DST processing unit 16 of FIG. 1, the integrity processing unit 20 of FIG. 1, and the managing unit 18 of FIG. 1. The DSN functions to modify a data access approach for stored data.
In an example of operation of the modifying of the data access approach, the migration unit 1530 determines to convert the legacy storage pool set 1510 from a generation addressing approach to a non-generation addressing approach, where the legacy storage pool set 1510 includes two or more storage generations. The generation addressing approach includes utilizing a slice name for an encoded data slice, where each slice name includes a generation field that indicates which storage generation is utilized for the encoded data slice. The non-generation addressing approach includes utilizing the slice name to map to a unique storage pool in accordance with rank scoring information of a distributed agreement protocol function. The determining includes at least one of detecting an unfavorable storage efficiency of the legacy storage pool set 1510 and receiving a request.
Having determined to convert the legacy storage pool set 1510, the migration unit 1530 converts a first storage generation of the legacy storage pool set 1510 into a first storage pool of the new storage pool set 1520. The converting includes facilitating physically moving of storage units and transferring slices directly. For example, when physically moving the storage units, the migration unit 1530 facilitates (e.g., issues migration information 1540, 1550, and/or 1560 via the network 24) moving the SUs 1-n of the storage generation 0 to become the SUs 1-n of the SU pool 1 of the new storage pool set 1520. As another example, when transferring slices directly, the migration unit 1530 instructs (e.g., issuing migration information 1540, 1550, and/or 1560 via the network 24) the SUs of the storage generation 0 to send all encoded data slices to the storage units of the SU pool 1 for storage. The converting further includes establishing distributed agreement protocol function location weights of the first storage pool to correspond to slice names of the transferred encoded data slices from the first generation.
Having established the first storage pool of the new storage pool set 1520, for each other storage generation of the two or more storage generations, the migration unit 1530 facilitates migration of encoded data slices from the other storage generation two one of the storage pools of the new storage pool set 1520 in accordance with the distributed agreement protocol function. For example, the migration unit 1530 performs the distributed agreement protocol function on a slice name of an encoded data slice for migration to produce ranked scoring information for the plurality of storage pools to identify the one storage pool (e.g., highest score) and facilitates migration of the encoded data slice from the storage generation to the identified storage pool (e.g., issues migration information 1540, 1550, and/or 1550 that includes a migration command or obtains the encoded data slice and sends the encoded data slice to the identified storage pool for storage. The facilitating may further include provisioning (e.g., facilitating the activation of additional SUs) of the other storage pools of the storage pool set in accordance with a storage utilization level of the legacy storage.
In an example of operation and implementation, a computing device (e.g., the migration unit 1530) includes an interface configured to interface and communicate with a dispersed or distributed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and to the memory. The processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations.
In an example, the computing device is configured to determine to convert sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs. Note that the generation-based storage pool set of SUs stores a plurality of sets of EDSs associated with the data object. Also, the data object is segmented into a plurality of data segments, and a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of the sets of encoded data slices (EDSs). The computing device is also configured to convert a first storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a first DAP-based set of the sets of EDSs in accordance with the DAP and stored within a first DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to pre-establish DAP scoring information that correspond to slice names of EDSs of the first storage generation set of the sets of EDSs associated with the data object.
Then, for additional generation sets of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs, the computing device is configured to perform a DAP function on a slice name to produce first DAP scoring information for DAP-based storage pools of SUs of the DAP-based storage pool set of SUs and to produce second DAP scoring information for sets of the EDSs associated with the data object stored within the generation-based storage pool set of SUs having the slice name. Also, the computing device is configured to migrate an EDS of the sets of EDSs associated with the data object stored within the generation-based storage pool set of SUs associated with the slice name and having highest DAP scoring information based on the second DAP scoring information to a DAP-based storage pool of SUs among the DAP-based storage pool set of SUs having highest DAP scoring information based on the first DAP scoring information.
In some examples, the computing device is also configured to determine to convert the sets of EDSs associated with the data object stored within a generation-based storage pool set of SUs to the DAP-based storage pool set of SUs based on detection of detect an unfavorable storage efficiency of the sets of EDSs associated with the data object within the generation-based storage pool set of SUs.
In other examples, the computing device is also configured to facilitate migration of a second storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a second DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs and facilitate migration of a third storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a third DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs. The computing device is also configured to perform the DAP function on the second storage generation set of the sets of EDSs associated with the data object stored within the second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate third DAP scoring information and perform the DAP function on the third storage generation set of the sets of EDSs associated with the data object stored within the third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate fourth DAP scoring information. The computing device is also configured to select the second DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the third DAP scoring information is higher than the fourth DAP scoring information and select the third DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the fourth DAP scoring information is higher than the third DAP scoring information.
In some examples, for the data segment, the computing device is configured to migrate at least a write threshold number of EDSs to the DAP-based storage pool of SUs among the DAP-based storage pool set of SUs, wherein the write threshold number of EDSs provides for a successful transfer of a set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN. Then, after migration of the at least a write threshold number of EDSs, the computing device is configured to re-provision at least one pool of SUs of the generation-based storage pool set of SUs to store at least one EDSs associated with another data object.
For the data segment associated with the set of the sets of EDSs, note that a decode threshold number of EDSs are needed to recover the data segment associated with the set of the sets of EDSs, and a read threshold number of EDSs provides for reconstruction of the data segment associated with the set of the sets of EDSs. Also, for the data segment, a write threshold number of EDSs provides for a successful transfer of the set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.
In some examples, the computing device is located at a first premises that is remotely located from at least one SU of the DAP-based storage pool set of SUs or the generation-based storage pool set of SUs within the DSN. In even other examples, the computing device includes a SU of the DAP-based storage pool set of SUs or the generation-based storage pool set of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device. Note also that the dispersed or distributed storage network (DSN) may be implemented in various ways and may include any one or more of a wireless communication system, a wire lined communication systems, a non-public intranet system, a public internet system, a local area network (LAN), and/or a wide area network (WAN).
FIG. 16A is a flowchart illustrating an example of modifying a data access approach for stored data. The method 1601 begins or continues at a step 1610 where a processing module (e.g., of a migration unit 1530) determines to convert a legacy storage pool set from a generation addressing approach to a non-generation addressing approach. The determining includes at least one of detecting an unfavorable storage efficiency of the legacy storage pool set and receiving a request.
The method 1601 continues at the step 1620 where the processing module converts a first storage generation of the legacy storage pool set into a first storage pool of the new storage pool set. For example, the processing module establishes the distributed agreement protocol function location weights of the first storage pool to correspond to slice names of encoded data slices stored in the first storage generation and establishes the first generation as the first storage pool or transfers the encoded data slices of the first storage generation to a new storage pool that has been provisioned as the first storage pool of the new storage pool set.
For each other storage generation of the legacy storage pool set, the method 1601 continues at the step 1630 where the processing module facilitates migration of encoded data slices from the other storage generation to one storage pool of the new storage pool set in accordance with a distributed agreement protocol function. For example, the processing module performs the distributed agreement protocol function on a slice name of an encoded data slice for migration to produce ranked scoring information for the plurality of storage pools of the new storage pool set to identify the one storage pool (e.g., associated with the highest score) and facilitates migration of encoded data slice from the storage generation to the identified storage pool (e.g., issues migration information that includes a migration command or obtains encoded data slice and sends the encoded data slice to the identified storage pool for storage). The facilitating may further include the processing module provisioning of other storage pools of the new storage pool set in accordance with a storage utilization level of the legacy storage pool set.
FIG. 16B is a diagram illustrating an embodiment of a method 1602 for execution by one or more computing devices in accordance with the present invention. The method 1602 operates by determining whether to convert sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs. In some examples, this determination is based on detection of detect an unfavorable storage efficiency of the sets of EDSs associated with the data object within the generation-based storage pool set of SUs. note that the generation-based storage pool set of SUs stores a plurality of sets of EDSs associated with the data object, and the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of the sets of encoded data slices (EDSs).
When it is determined not to perform the conversion in step 1621, the method 1602 ends. Alternatively, when it is determined not to perform the conversion in step 1621, the method 1602 operates in step 1631 by converting a first storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a first DAP-based set of the sets of EDSs in accordance with the DAP and stored within a first DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to pre-establish DAP scoring information that correspond to slice names of EDSs of the first storage generation set of the sets of EDSs associated with the data object. Then, for additional generation sets of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs (as shown in step 1641, the method 1602 operates by performing a DAP function on a slice name to produce first DAP scoring information for DAP-based storage pools of SUs of the DAP-based storage pool set of SUs and to produce second DAP scoring information for sets of the EDSs associated with the data object stored within the generation-based storage pool set of SUs having the slice name. The method 1602 also operates by migrating (e.g., via an interface configured to interface and communicate with the DSN) an EDS of the sets of EDSs associated with the data object stored within the generation-based storage pool set of SUs associated with the slice name and having highest DAP scoring information based on the second DAP scoring information to a DAP-based storage pool of SUs among the DAP-based storage pool set of SUs having highest DAP scoring information based on the first DAP scoring information.
In some examples and embodiments, a variant of the method 1602 operates by performing additional facilitating migration of a second storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a second DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs. Such a variant of the method 1602 also operates by facilitating migration of a third storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a third DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs. Such a variant of the method 1602 also continues by performing the DAP function on the second storage generation set of the sets of EDSs associated with the data object stored within the second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate third DAP scoring information and performing the DAP function on the third storage generation set of the sets of EDSs associated with the data object stored within the third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate fourth DAP scoring information. Then Such a variant of the method 1602 also operates by selecting the second DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the third DAP scoring information is higher than the fourth DAP scoring information or alternatively selecting the third DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the fourth DAP scoring information is higher than the third DAP scoring information.
In even other examples, for the data segment, another variant of the method 1602 operates by migrating at least a write threshold number of EDSs to the DAP-based storage pool of SUs among the DAP-based storage pool set of SUs, wherein the write threshold number of EDSs provides for a successful transfer of a set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN. Then, after migration of the at least a write threshold number of EDSs, such another variant of the method 1602 operates by re-provisioning at least one pool of SUs of the generation-based storage pool set of SUs to store at least one EDSs associated with another data object.
With respect to a data segment such as associated with the set of the sets of EDSs, note that a decode threshold number of EDSs are needed to recover the data segment associated with the set of the sets of EDSs, and a read threshold number of EDSs provides for reconstruction of the data segment associated with the set of the sets of EDSs. Also, a write threshold number of EDSs provides for a successful transfer of the set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.
This disclosure presents, among other things, migration of data within and among various types of data storage systems. For example, for dispersed or distributed storage network (DSN) deployments that utilize multiple generations, moving data from a generation-based and/or model to a generation-less system (e.g., non-generation-based, a Decentralized, or Distributed, Agreement Protocol (DAP)-based system and/or model) can present some challenges that the prior art cannot address. Considering an example, in a case where there is a single generation in a generation-based system, the migration path may be viewed as being straight forward. However, when there are 2 or more generation of data in a generation-based system, then the generations beyond the 0-th generation cannot be so easily merged. One approach is to initiate a bi-directional migration and proxying between the system such as operating to treat them as two separate storage pools both of which hold sources that belong to the other according to the generation-less system (e.g., non-generation-based, a DAP-based system and/or model). This also may have some additional complexities. An alternate strategy which involves only unidirectional proxying and migration and may be performed as follows: Convert “generation 0” only into the first storage pool of its own new “storage pool set”; Provision new storage resources (at least as large as a generation N) where generation N is a generation to be collapsed; Assign these new storage resources as a new storage pool in the same storage pool set as what was formerly generation 0; and Trigger a one-way migration from generation N toward this storage pool set. Also, when the migration is completed, the system may operate to re-provision the storage units (SUs) in generation N, perhaps as a new pool to be added to any storage pool set in the system, and/or perform other operations that effectively re-deploy, re-provision, re-use those SUs for other uses that are now available after an effective migration.
determine to convert sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs, wherein the generation-based storage pool set of SUs stores a plurality of sets of EDSs associated with the data object, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of the sets of encoded data slices (EDSs);
convert a first storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a first DAP-based set of the sets of EDSs in accordance with the DAP and stored within a first DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to pre-establish DAP scoring information that correspond to slice names of EDSs of the first storage generation set of the sets of EDSs associated with the data object;
for additional generation sets of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs:
perform a DAP function on a slice name to produce first DAP scoring information for DAP-based storage pools of SUs of the DAP-based storage pool set of SUs and to produce second DAP scoring information for sets of the EDSs associated with the data object stored within the generation-based storage pool set of SUs having the slice name; and
migrate an EDS of the sets of EDSs associated with the data object stored within the generation-based storage pool set of SUs associated with the slice name and having highest DAP scoring information based on the second DAP scoring information to a DAP-based storage pool of SUs among the DAP-based storage pool set of SUs having highest DAP scoring information based on the first DAP scoring information.
determine to convert the sets of EDSs associated with the data object stored within a generation-based storage pool set of SUs to the DAP-based storage pool set of SUs based on detection of detect an unfavorable storage efficiency of the sets of EDSs associated with the data object within the generation-based storage pool set of SUs.
facilitate migration of a second storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a second DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs;
facilitate migration of a third storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a third DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs;
perform the DAP function on the second storage generation set of the sets of EDSs associated with the data object stored within the second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate third DAP scoring information;
perform the DAP function on the third storage generation set of the sets of EDSs associated with the data object stored within the third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate fourth DAP scoring information;
select the second DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the third DAP scoring information is higher than the fourth DAP scoring information; and
select the third DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the fourth DAP scoring information is higher than the third DAP scoring information.
for the data segment, migrate at least a write threshold number of EDSs to the DAP-based storage pool of SUs among the DAP-based storage pool set of SUs, wherein the write threshold number of EDSs provides for a successful transfer of a set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN; and
after migration of the at least a write threshold number of EDSs, re-provision at least one pool of SUs of the generation-based storage pool set of SUs to store at least one EDSs associated with another data object.
a decode threshold number of EDSs are needed to recover the data segment associated with the set of the sets of EDSs;
a read threshold number of EDSs provides for reconstruction of the data segment associated with the set of the sets of EDSs; and
for the data segment, a write threshold number of EDSs provides for a successful transfer of the set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.
6. The computing device of claim 1, wherein the computing device is located at a first premises that is remotely located from at least one SU of the DAP-based storage pool set of SUs or the generation-based storage pool set of SUs within the DSN.
a SU of the DAP-based storage pool set of SUs or the generation-based storage pool set of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.
determine to convert sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs based on detection of detect an unfavorable storage efficiency of the sets of EDSs associated with the data object within the generation-based storage pool set of SUs, wherein the generation-based storage pool set of SUs stores a plurality of sets of EDSs associated with the data object, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of the sets of encoded data slices (EDSs), wherein a decode threshold number of EDSs are needed to recover the data segment associated with the set of the sets of EDSs, wherein a read threshold number of EDSs provides for reconstruction of the data segment associated with the set of the sets of EDSs, and wherein a write threshold number of EDSs provides for a successful transfer of the set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN for the data segment;
determining to convert sets of encoded data slices (EDSs) associated with a data object stored within a generation-based storage pool set of storage units (SUs) to a Decentralized, or Distributed, Agreement Protocol (DAP)-based storage pool set of SUs within a dispersed or distributed storage network (DSN), wherein the generation-based storage pool set of SUs stores a plurality of sets of EDSs associated with the data object, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of the sets of encoded data slices (EDSs);
converting a first storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a first DAP-based set of the sets of EDSs in accordance with the DAP and stored within a first DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to pre-establish DAP scoring information that correspond to slice names of EDSs of the first storage generation set of the sets of EDSs associated with the data object;
performing a DAP function on a slice name to produce first DAP scoring information for DAP-based storage pools of SUs of the DAP-based storage pool set of SUs and to produce second DAP scoring information for sets of the EDSs associated with the data object stored within the generation-based storage pool set of SUs having the slice name; and
migrating, via an interface configured to interface and communicate with the DSN, an EDS of the sets of EDSs associated with the data object stored within the generation-based storage pool set of SUs associated with the slice name and having highest DAP scoring information based on the second DAP scoring information to a DAP-based storage pool of SUs among the DAP-based storage pool set of SUs having highest DAP scoring information based on the first DAP scoring information.
determining to convert the sets of EDSs associated with the data object stored within a generation-based storage pool set of SUs to the DAP-based storage pool set of SUs based on detection of detect an unfavorable storage efficiency of the sets of EDSs associated with the data object within the generation-based storage pool set of SUs.
facilitating migration of a second storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a second DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs;
facilitating migration of a third storage generation set of the sets of EDSs associated with the data object and stored within the generation-based storage pool set of SUs into a third DAP-based set of the sets of EDSs in accordance with the DAP to be stored in a third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs;
performing the DAP function on the second storage generation set of the sets of EDSs associated with the data object stored within the second DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate third DAP scoring information;
performing the DAP function on the third storage generation set of the sets of EDSs associated with the data object stored within the third DAP-based storage pool of SUs of the DAP-based storage pool set of SUs to generate fourth DAP scoring information;
selecting the second DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the third DAP scoring information is higher than the fourth DAP scoring information; and
selecting the third DAP-based storage pool of SUs as the DAP-based storage pool of SUs when the fourth DAP scoring information is higher than the third DAP scoring information.
for the data segment, migrating at least a write threshold number of EDSs to the DAP-based storage pool of SUs among the DAP-based storage pool set of SUs, wherein the write threshold number of EDSs provides for a successful transfer of a set of the sets of EDSs from a first at least one location in the DSN to a second at least one location in the DSN; and
after migration of the at least a write threshold number of EDSs, re-provisioning at least one pool of SUs of the generation-based storage pool set of SUs to store at least one EDSs associated with another data object.
19. The method of claim 14, wherein the computing device includes a SU of the DAP-based storage pool set of SUs or the generation-based storage pool set of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.
US15/448,148 2009-12-29 2017-03-02 Generation collapse Active US10001923B2 (en)
US201562154867P true 2015-04-30 2015-04-30
US15/056,517 US9727266B2 (en) 2009-12-29 2016-02-29 Selecting storage units in a dispersed storage network
US15/448,148 US10001923B2 (en) 2009-12-29 2017-03-02 Generation collapse
US15/056,517 Continuation-In-Part US9727266B2 (en) 2009-12-29 2016-02-29 Selecting storage units in a dispersed storage network
US20170177228A1 US20170177228A1 (en) 2017-06-22
US10001923B2 true US10001923B2 (en) 2018-06-19
ID=59066305
US15/448,148 Active US10001923B2 (en) 2009-12-29 2017-03-02 Generation collapse
US (1) US10001923B2 (en)
US20080154408A1 (en) 1999-09-21 2008-06-26 Sony Corporation Communication system and its method and communication apparatus and its method
US20090083809A1 (en) 2006-08-21 2009-03-26 Brother Kogyo Kabushiki Kaisha Content distributed-storage system, frame image obtaining method, node device, and recording medium on which node processing program is recorded
US20090157740A1 (en) 2007-12-14 2009-06-18 Casdex, Inc. System for Logging and Reporting Access to Content Using Unique Content Identifiers
2017-03-02 US US15/448,148 patent/US10001923B2/en active Active
US20170177228A1 (en) 2017-06-22
US20170168717A1 (en) 2017-06-15 Dispersed storage network (dsn) and system with improved security
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BAPTIST, ANDREW D.;MOTWANI, MANISH;RESCH, JASON K.;SIGNING DATES FROM 20170224 TO 20170227;REEL/FRAME:041445/0643