Crawling works, entries are saved in database but its painfully slow
Added description for generating file index on sftp server using find and crontab