revert thread causes too much timeout
remove threaded crawler, too many issues