tokens: To place your code there you can either try monkey patching ScrapyAgent.download_request or to subclass ScrapyAgent to do the request logging , then subclass HTTP11DownloadHandler to use your Scrapy Agent and then set HTTP11DownloadHandler as new DOWNLOAD_HANDLER for http / https requests in your project 's settings.py ( for details see : https://doc.scrapy.org/en/latest/topics/settings.html#download-handlers )
ner_tags: O O O O O O O O O O O B-Function O O O B-Class O O O O O O O O B-Class O O O B-Library O O O O B-Class O O B-Class O O O O O O O O O B-File_Name O O O O O O O