even if new ids are not found, still continue if ids in json still need to be processed