renamed method parse_config to parse_cli_config. refs #14
renamed method parse_config to parse_cli_config. refs #14
Added small doc about API. refs #14
Implemented crawl_with_options. refs #14