slicing out crawler logic from browser app