Reduce traffic between the mysql server and the crawler