Yes, it should be called for both success and failure. We are waiting for the certain number of files to be processed (either successfully or with failures)