smarter scanning - look for index files in depth