stream apis
test proxies
refactor, add search_for function, need more work to create crawler dynamically per request
allow crawling without proxy
remove temp data