Rate limited my Payload.AddDir to 200 files at a time.