Remove then callback from crawler js file. 
It's not crawler's responsibility to call afterSuccessCallback.
Remove the duplicate products.