Make sure we don't process any files more than once
Not using pagination for now