Fix stupid logic where i didn't complete the custom DATA dir stuff.
Add in a progress counter, because processing the csv takes time.