Implement crawl_obj_open()
Improve logging; process boolean configurationv values properly.
Improve failure logging.
Improve debug logging.
Improve logging; use crawl_obj_open()
Add the crawler-add utility.