sematext/HBaseHUT — Issue #9: Implement partial compaction (updates processing)
Author: abaranau
Created: 2012-03-07 21:18:02+00:00
State: open

After updates compacted (e.g. processed by MR job) there's no way to perform partial rollback operation on the updates.
So, to preserve partial updates rollback ability and still have *somewhat* compacted data (to reduce amount of processed on the fly data during reading) we need "partial compaction". This particular issue is about enabling partial compaction based on records falling into same N ms long time interval.

Example:
* updates have been written for 90 days
* partial compaction performed based on 1-day interval
In that case upon retrieving data not more than 90 records will be processed on the fly. At the same time updates can be rolled back with 1-day interval granularity.