new api. tossed action/expression
and added urlCrawlPattern/urlProcessPattern/apiUrl
Merge branch 'diffbot' of github.com:gigablast/open-source-search-engine into diffbot

Conflicts:
	XmlDoc.cpp
Merge branch 'diffbot' of github.com:gigablast/open-source-search-engine into diffbot

Conflicts:
	Spider.cpp
add ! support to all patterns
forgot to add diffbot api url parm
Merge branch 'diffbot' of github.com:gigablast/open-source-search-engine into diffbot
fix url filters formulation.
fixed extra , in json.
fixed upp and ucp patterns if all substrings
are negative.
Merge branch 'diffbot' of github.com:gigablast/open-source-search-engine into diffbot