Search engine spiders simply can't index pages that have no content to evaluate or links to follow. Unlike humans, spiders love text-heavy, ugly pages . Search Engine Power Pack contains META Mechanic , a META tag generator that can help you quickly write effective META tags for your site. Spiders Hate Confined Spaces. You have to give a search engine spider a good reason to crawl through your frame because they have an uneasy relationship with framed sites.
Many spiders can only see the top-level frame code.
With nothing to see and do, the spider leaves your site without indexing it. There Was No Room At The Inn. Some search engine databases have an upper limit on the number of pages they can index. When the database is full, they don't place your site on a waiting list. You may have to submit several times to the same engine before getting one of the coveted database spots.