While robots.txt can instruct crawlers not to crawl specific pages, it does not guarantee that those pages will not be indexed. If a page is linked from other indexed pages, it might still be indexed