Added untested tests
fixed test class
Added fixed crawler instance method stubs
cleaned up redundant files