pdcrawlers and others updated with database runs 3 times on peoples daily