Added pruning feature to remove links after they have been cached successfuly.  Needed to handle cache depletion better so that we running in pruning mode, the threadhandler would stop in a graceful manner.