page availability check.
Collect all child URLs

Additional step to fix the problem Duc spotted with bitdefender.com
webpage
website
data Analyzer
Merge branch 'louis' of https://github.com/trthanhquang/wayback-data-collector into louis

Conflicts:
	.gitignore
Extract Price from Crawled String
Collect snapshots' links
software List hlookup to get URL
Merge remote-tracking branch 'origin/gh-pages' into louis
Revert "software List hlookup to get URL"

This reverts commit cdf3edf66f01ab7cf4013e6217a88da67ce4b637.
Revert "Merge remote-tracking branch 'origin/gh-pages' into louis"

This reverts commit 55ac3024b91c835b99654dc4943b736c16c0eb35, reversing
changes made to cdf3edf66f01ab7cf4013e6217a88da67ce4b637.
Revert "Revert "software List hlookup to get URL""

This reverts commit 129b54022a34ff0c1e15753d8ed0d5f59df6589d.
convert html to meaningful text
Dictionary of frequently appeared Linking Words

Words to be ignored when judging if a paragraph may contain keywords
Extract meaningful text and Rank word frequency
push crawled data to temp mysql db
html crawler, analyzer & clean up repo
cleanup, prepare to merge
Merge remote-tracking branch 'origin/master' into louis