Compress intermediate results after specified iterations
Failure recovery and auto optimization

Not finished. Under development and testing.
update