streamparse working branch.  topology is partially defined and non-functional at this point.
added crawler bolt as simple standin for distributed crawling infrastructure
updated topology for sample crawler.  crawler output not connected
Merge branch 'master' into streamparse
added cralwer kafka topics - topology still prototyped / non functional
added new local topology - non functional
Merge branch 'master' into streamparse
streamparse: completed initial topology flow with crawler api.  TODO write data out to datastore. Currently writes to local file for test only.
merge with master

 streamparse branch with master
streamparse write data to local db

Added dataconnector to write entities to mysql.

Need to split out visited, crawler, and lookahead to seperate
topologies and run via sparse submit to local storm cluster vice using
sparse run.
streamparse local topology update

bulk write of extracted data from extractor bolt.  Domain specific
writes down in domain-writer-bolt
remove lower case from url extractor
forensic lookahead fixes

fix for lookahead issue caused by updated datamodel
Merge branch 'master' into streamparse
replaced mock_backend with streamparse
add vagrant private network
lookahead spout emit bug fix
Merge pull request #16 from Sotera/streamparse

Streamparse