Refactored _crawlPage method to be more testable
Added more thorough tests for _crawlPage method
Moved some requestSpec code into funcSpec