This version of code crawls entire wikipedia categories and preserves complete hierarchy.
When a category page is fetched, all its articles are stored in article_category file and all the subcategories are written in full_tree file
Two log files are maintained.