gz, cat and dd, all have bound to so called pipe-size which acts weird with ulimit buffer size of 64k.. turns out, using lzop stdin stdout, you can not only speed up the things but avoid overhead.. suggestion to combine the processes by adam goryachev