Code simplification. Moved unentify() into the crawler.
Updated the documentation.