removed BOF
Added main()
Use standard python logging
Remove race condition when using lock file
Merge pull request #1 from zart/crawler-unfuck

Crawler unfuck