Beautified code. Separated simgle threaded from multithreaded crawler. Rule Crawler to be modeled as a crawler library instead of a standalone application