now support complete paths when download file
support versions of file
now can get resources from another another url
solved problem to load local assets
Merge branch 'hotfix/load-assets-html-file' into develop
beautifulsoup finally implemented
Merge branch 'feature/change-to-beautifulsoup' into develop
experiments
introduce sitemap
initialized SignalBase
now crawler navigate in pages recursively
main module
include some tests to crawler
included get_headers to verify if request is a file
crawler and download work together
remove unused files
download recursively
refactoring crawler
refactoring download.py
treatment errors in download