crawler improvements, not yet perfect
Merge branch 'master' of https://github.com/sagieske/NLP1