fixes caching bug #21, removes un-verified and deleted links after a re-scan, and adds them back if they are discovered again.