returneksibir/kitap-yakala — Issue #20: Kitapyurdu spider is broken
Author: rimbi
Created: 2011-10-13 18:40:02+00:00
State: open

Don't know what happened. Here is the output of the spider:

Sayfa :http://www.kitapyurdu.com/kitap/default.asp?id=585237
------- Kitapyurdu - Mobile | Anasayfa -------
Price information is not in TL
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588726
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?publisher=1
Sayfa :http://www.kitapyurdu.com/kitap/Campaings.aspx
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587206
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588816
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588090
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?catalog=8
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?yazar=1
Sayfa :http://www.kitapyurdu.com/kitap
Sayfa :http://www.kitapyurdu.com
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=35610
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?catalog=7
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588205
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587910
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587404
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588134
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588224
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588422
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588719
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588092
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587816
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=464166
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?catalog=6
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588178
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587880
Sayfa :http://www.kitapyurdu.com/kitap/Default.aspx
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?catalog=5
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588255
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=588023
Sayfa :http://www.kitapyurdu.com/kitap/ProductDetails.aspx?product=587300
Sayfa :http://www.kitapyurdu.com/kitap/Catalog.aspx?category=1
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588726
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?publisher=1
Sayfa :http://www.kitapyurdu.com/Campaings.aspx
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587206
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588816
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588090
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?catalog=8
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?yazar=1
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=35610
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?catalog=7
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588205
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587910
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587404
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588134
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588224
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588422
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588719
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588092
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587816
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=464166
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?catalog=6
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588178
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587880
Sayfa :http://www.kitapyurdu.com/Default.aspx
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?catalog=5
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588255
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=588023
Sayfa :http://www.kitapyurdu.com/ProductDetails.aspx?product=587300
Sayfa :http://www.kitapyurdu.com/Catalog.aspx?category=1
Sayfa :http://ProductDetails.aspx?product=588726
Sayfa :http://Catalog.aspx?publisher=1
Sayfa :http://Campaings.aspx
Sayfa :http://ProductDetails.aspx?product=587206
Sayfa :http://ProductDetails.aspx?product=588816
Sayfa :http://ProductDetails.aspx?product=588090
Sayfa :http://Catalog.aspx?catalog=8
Sayfa :http://Catalog.aspx?yazar=1

The crawler just halts after this point.