updated batch process to avoid hitting requests/sec limits of API.