first running version with both incremental and full harvest functionality