SftpServerCrawler now first looks in every directory if there is a sftp-indexer-index.gz file to offload the sftp connection.