added support to scrap subpages of categories