added crawler support
Merge branch 'test' of https://github.com/sz-cs130/seo-tool-team2 into test