Module Expr Str ImportFrom alias alias alias alias If CompareEq NameLoad Str body Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad keyword Str keyword Str keyword Str keyword Str keyword Str keyword ListLoad Str Str Str keyword NameLoad Expr Call AttributeLoad NameLoad attr ListComp Call NameLoad AttributeLoad NameLoad attr comprehension NameStore AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr For NameStore NameLoad body Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad Assign NameStore ListComp Call NameLoad AttributeLoad NameLoad attr comprehension NameStore AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad
N/A N/A 
Frontier from parameters example
 frontera FrontierManager graphs Request Response N/A N/A __name__ __main__ N/A N/A graph N/A N/A graphs Manager sqlite:///data/graph.db N/A frontier N/A FrontierManager request_model frontera.core.models.Request response_model frontera.core.models.Response backend frontera.contrib.backends.memory.FIFO logger frontera.logger.FrontierLogger event_log_manager frontera.logger.events.EventLogManager middlewares N/A frontera.contrib.middlewares.domain.DomainMiddleware frontera.contrib.middlewares.fingerprint.UrlFingerprintMiddleware frontera.contrib.middlewares.fingerprint.DomainFingerprintMiddleware test_mode True N/A N/A N/A frontier add_seeds N/A N/A Request N/A seed url N/A seed N/A graph seeds N/A next_requests N/A N/A frontier get_next_requests N/A request next_requests N/A N/A crawled_page N/A N/A graph get_page N/A request url N/A response N/A Response url N/A request url status_code N/A crawled_page status request request N/A page_links N/A N/A Request N/A link url N/A link N/A crawled_page links N/A N/A N/A frontier page_crawled response response links page_links