Added master index for domain, which contains list of downloaded urls. Let document reader iterate over this master index.