changed the crawler. the crawler only stops if all detailpages are allready crawled. it can happen that one article is on more than one page: