Patent ID: 8280895
Filing Date: 2012-10-02
Classification: G06F

Abstract:
1. A multi-streamed method for parallelized interlacing of data for backup comprises: receiving and storing a list of most frequently encountered type 2 pieces each of which comprise a data hash determined from a type 3 piece which comprise a file data shard having variable length up to a maximum size; receiving and storing a list of object identities organized by file size wherein objects comprise files; operating on a plurality of files simultaneously using a plurality of parallel threads controlling one or more processors by within a first parallel thread, while there is any object identity remaining on said list of object identities organized by file size, removing a top file identity from a top of the list, reading a top file from non-volatile mass store, and operating on said top file to determine type 1, type 2, and type 3 pieces; within a second parallel thread, while there is any object identity remaining on said list of object identities organized by file size, removing a bottom file identity from a bottom of the list, reading a bottom file from non-volatile mass store, and operating on said bottom file to determine type 1, type 2, and type 3 pieces; until piece store is full, in the following order, for each file operated on, writing type 1 piece to a piece store, then, subsequently writing one or more type 2 pieces to the piece store, and finally, writing one or more type 3 pieces to the piece store; comparing each type 2 piece stored in the piece store with—the list of most frequently encountered type 2 pieces, and removing from the piece store any type 3 piece which corresponds to a most frequently encountered type 2 piece.