web-search-api / networks /webpage_fetcher.py

Commit History

:recycle: [Refactor] Replace output_path with html_path to avoid confuse
8c0b736

Hansimov commited on

:boom: [Fix] WebpageFetcher: raise timeout when request.get hangs
bce51d4

Hansimov commited on

:zap: [Enhance] BatchWebpageFetcher: return url_and_output_path_list
4591d96

Hansimov commited on

:gem: [Feature] New BatchWebpageFetcher: Fetch multiple urls concurrently
e92817a

Hansimov commited on

:zap: [Enhance] Rename HTMLFetcher to WebpageFetcher, and add output_parent param
62ee9e4

Hansimov commited on