support for removal of bad urls