update admin link on root page and
documentation for url filters
fix spidering getting stuck bug
Merge branch 'master' of git@github.com:gigablast/open-source-search-engine
more spider fixes
revert last commit. not needed
fixes for spiders getting stuck
fix spider core
fixed './gb inject titledb newhosts.conf'
You have to be in working directory of the instance
whose cached pages (titlerecs) you want to inject
into the new cluster defined by newhosts.conf.
fixed 'gb inject titledb-DIR newhosts.conf' command
for populating an index from titledb files in DIR
and transmitting to appropriate host in newhosts.conf.
also prettied up the gb -h output to use a formatting
function.
fix compiler warning
increase hardware requirements to 4GB from 500MB until
we adjust in-memory structure mem usage dynamically.
Merge branch 'master' into diffbot

Conflicts:
	Collectiondb.cpp
	Msg13.cpp
	Parms.cpp
	Spider.h