initial commit
added README
updated README
starting on scraper, tests
added indexing
minor changes
extracting words
completed extract_all_words
adding extract links
working on extracting links
stemmed the words extracted
complete SaushEngine indexer!
placed an upper ceiling to the number of messages in the queue before the spider stops extracting links anymore
Switched to JRuby
added digger
cleaning up file names
added ui for digger
renamed worker.rb to spider.rb, minor tweaks to digger UI, added a bit of README
added importance of search algorithm in the calculation
Added support for nltm authentication with 4 new configuration option; ntlm, ntlm_user, ntlm_domain, ntlm_password