return request header if requested
add README.md
add target for pdf/docu
basic webcrawler implementation
write index to ./index directory