Write data to files split by topic and rolled over on size or a timeout, files can be compressed using lzo, snappy or gzip