added new logic to handle responses from 30 days ago with pagination