crawler test coverage fixes
Add more db unit testing

Rework feed_watcher to no block waiting for a crawler to become available.