Doc updates. Refactoring.

- Simplified the API for crawler.parseField
- Updated usage examples.
- Fixed a bug with the blacklist/whitelist functionality.