config, readmes
crawler update: command line parameters, cleaned recommended lex, etc.
fixes
.
renaming
Update README.md
doc
.
.
.
adaptive crawling v0.0, docs, small fixes.
Update LICENSE
Update Readme.