DataTorrent/Malhar — pull request #1027 by tushargosavi (2014-08-26 15:59:06+00:00)
Title: Hds

Changes containing in this pull request.

Remove not required metadata for WAL, only store head (where new data is added ) and tail pointers, each pointer consist of wal file id and offset within that file.

Maintain WAL metadata as part of operator check-pointed state. (walMeta member)

Cleanup old WAL files, once tuples from them are written to data files.