added crawler code
added stats comparison