add crawler
Merge branch 'master' into crawler_work
minor changes in gitignore
add bin dir
clear bin
ignoring bin folder
switch page read, enabled image href grabbing
minor changes
...
switching to stringtokenizer
increase depth of search
add TODO
Merge branch 'crawler_work'
merged with crawler