fixed minor documentation errors, improved worker code, added "ALL" crawl option, fixed fable to incorporate "queue.py" -> "file queue.py"