mongo and sql databases
crawler exploration
query results seq
persist in mongo
read results from database