consistency updates and removal of bad links