On my site is a page that hosts all my ad entries. Each URL and its content is different. Google was indexing all the different URLs until entry 4570. As I can see in GWT Google Index they also stopped crawling the new entries (70,000) at this moment.

I would like to understand why Google stopped. I added a sitemap at about this time. The sitemap generator doesn't produce the single ad URLs.

I had to change a page name and put a redirect in my .htaccess file:

Redirect permanent /aerzte/ http://www.example.de/arzt/


Google stopped about one week later to add new URLs. Can one of above be the reason?

Is there a different solution - without sitemap - to get Google to index these URLs?

P.S.: I can add URLs with Google Fetch and these URLs are immediately indexed.


Question: C# & VS error: "make sure that the maximum index on a list is less than the list size"
Answer: End your loop earlier:

for (int i = 0; i &lt; luvut.Length - 1; i++)


This stops the loop ever getting to the point where an index would be invalid.