various fixes.
prioritize process only urls over crawl urls to get data faster.
do not merge on high negative rec concentration. we need to fix that more.
allow simplified redirs again for custom crawls to avoid too many dups.
raise crawlinfo delay from 1 sec to 5 secs to reduce network usage
for now. add back in injection enabled parm, but hidden.
fix tags.uri:org/resource/Foo" query
fix so tags.uri:foo/bar/baz is treated like
tags.uri:"foo/bar/baz". also fixed another
quote-related bug.
Merge branch 'diffbot-testing' into testing