Safer checking of what packrat can decide to remove