Module Import alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias ImportFrom alias ImportFrom alias ImportFrom alias ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad NameLoad NameLoad TryExcept body Expr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler body Pass Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr If NameLoad body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If CompareIs AttributeLoad NameLoad attr NameLoad body Assign AttributeStore NameLoad attr Call NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr Return AttributeLoad NameLoad attr decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Expr Str Return Call NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Return Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults kwarg body Expr Str Return Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults kwarg body Expr Str Return Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults kwarg body Expr Str Return Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults kwarg body Expr Str Return Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad Print BinOpMod Str NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return BinOpMod Str AttributeLoad NameLoad attr decorator_list decorator_list
N/A N/A os N/A atexit uuid uuid4 datetime datetime threading local scrapekit.config Config scrapekit.tasks TaskManager Task scrapekit.http make_session scrapekit.logs make_logger scrapekit reporting Scraper N/A object N/A N/A  Scraper application object which handles resource management
    for a variety of related functions.  __init__ N/A N/A self name config report N/A None False N/A N/A N/A self name name N/A N/A self id N/A uuid4 N/A N/A self start_time N/A N/A datetime utcnow N/A N/A self config N/A Config self config N/A N/A N/A N/A N/A os makedirs N/A N/A self config data_path N/A N/A N/A N/A N/A N/A self _task_manager None N/A N/A self task_ctx N/A local N/A N/A self log N/A make_logger self N/A N/A self session N/A N/A self Session N/A report N/A N/A N/A N/A atexit register N/A self report N/A task_manager N/A N/A self N/A N/A N/A N/A N/A self _task_manager None N/A N/A N/A self _task_manager N/A TaskManager threads N/A N/A self config threads N/A N/A self _task_manager N/A property task N/A N/A self fn N/A N/A N/A  Decorate a function as a task in the scraper framework.
        This will enable the function to be queued and executed in
        a separate thread, allowing for the execution of the scraper
        to be asynchronous.
         N/A N/A Task self fn N/A Session N/A N/A self N/A N/A N/A  Create a pre-configured ``requests`` session instance
        that can be used to run HTTP requests. This instance will
        potentially be cached, or a stub, depending on the
        configuration of the scraper.  N/A N/A make_session self N/A head N/A N/A self url N/A kwargs N/A N/A  HTTP HEAD via ``requests``.

        See: http://docs.python-requests.org/en/latest/api/#requests.head
         N/A N/A N/A N/A N/A self Session get url kwargs N/A get N/A N/A self url N/A kwargs N/A N/A  HTTP GET via ``requests``.

        See: http://docs.python-requests.org/en/latest/api/#requests.get
         N/A N/A N/A N/A N/A self Session get url kwargs N/A post N/A N/A self url N/A kwargs N/A N/A  HTTP POST via ``requests``.

        See: http://docs.python-requests.org/en/latest/api/#requests.post
         N/A N/A N/A N/A N/A self Session post url kwargs N/A put N/A N/A self url N/A kwargs N/A N/A  HTTP PUT via ``requests``.

        See: http://docs.python-requests.org/en/latest/api/#requests.put
         N/A N/A N/A N/A N/A self Session put url kwargs N/A report N/A N/A self N/A N/A N/A  Generate a static HTML report for the last runs of the
        scraper from its log file.  N/A index_file N/A N/A reporting generate self N/A N/A Report available at: file://%s index_file N/A __repr__ N/A N/A self N/A N/A N/A N/A <Scraper(%s)> N/A self name N/A N/A