check subPages for errors - skip urls with diff domain
Merge branch 'test_branch' of https://github.com/Morphik83/scripts into test_branch
web_crawler first draft
redirect_tool - cwd added
_smart moved
delete _smart
comment removed