msfrank/terane — Issue #39: compress db data
Author: msfrank
Created: 2011-12-01 07:33:01+00:00
State: open
Labels: enhancement

currently, 1 event on average takes up about 10kb of space on disk. we may be able to reduce this by adding data compression. there are a lot of different compression libraries available out there, but the current state-of-the-art seems to be LZMA/LZMA2:

http://www.7-zip.org/sdk.html

zlib or bzip2 are also obvious choices. both of these are much more likely to be present on a system than lzma, but lzma seems to be gaining in popularity. since the lzma sdk is small and public domain, we can also easily copy it into terane if needed.