Add native batch put support to leveldb

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add configurable block size to leveldb

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add configurable LRU cache to the leveldb index

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add TODO comment to block index.

It is not clear why the block index importing stops at 16K blocks and
then waits for the log replay.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Fixes a unit test.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add *.rej files to remove tmp files script

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add a long missing uncrustify run

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add a C++ hash class for murmur hashing.

This allows using murmur hashing in std::map et al.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add the block hint field to chunk mapping.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add a method for the ordered iteration over LRU-cached objects

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Fix compile error in bloom filter unit test

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add const accessor to block size in block index.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add UpdateKnownChunk method to the filters.

This method is called after a non chunk has been fully processed.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add executable permission for the format src script

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add the Block Locality Caching (BLC) system.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
dedupv1_test uses configuration file ~/.dedupv1_test

It is possible to configure the "temp dir" in the configuration
file, so that it is not necessary to provide it each time.
If a temp dir is used on the command line, then the command line value
is used.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Fix method signatures of all filters

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Add a new dedup system test.

This also fixes a undefined behavior in a test.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Change format source scripts and add a git hook that ensures style.

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>
Update protobuf from 2.3.0 to 2.5.0

The updated version promises "various speed improvements".

Signed-off-by: jkaiser <jkaiser@kaiserj-2.zdv.uni-mainz.de>