added diff comparison in client and edited crawler