Added incremental processing mode

Based on what's already available, only process the data we need