Added user agent string for Windows Mozilla to recursive crawler. Code cleanup